Fully open data curation for reasoning models

Awesome Reasoning LLM Tutorial/Survey/Guide

An Open-sourced Knowledgable Large Language Model Framework.

The MATH Dataset (NeurIPS 2021)

Latest Advances on System-2 Reasoning

Understanding R1-Zero-Like Training: A Critical Perspective

Pretraining code for a large-scale depth-recurrent language model

LLMs can generate feedback on their work, use it to improve the output, and repeat this process iteratively.

Explore the Multimodal “Aha Moment” on 2B Model

code and docs for my EMNLP paper "DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoning"

PaL: Program-Aided Language Models (ICML 2023)

Recognition to Cognition Networks (code for the model in "From Recognition to Cognition: Visual Commonsense Reasoning", CVPR 2019)

Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"

Recurrent Event Network: Autoregressive Structure Inference over Temporal Knowledge Graphs (EMNLP 2020)

Open-source generalized AI agent for everyday task automations.

Official Implementation of ICLR 2024 paper: "Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning"

[ACL 2024] An Easy-to-use Instruction Processing Framework for LLMs.

Implementation for "Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs"

Collect every awesome work about r1!

multi1: create o1-like reasoning chains with multiple AI providers (and locally). Supports LiteLLM as backend too for 100+ providers at once.