Skip to content
ToolOpen-source agent

rllm

Reinforcement-learning framework for training language agents on any harness

Pricing
Open source
Platforms
CLI, self-hosted
GitHub stars
5.9K
Last commit
1 month ago
Language
Python
License
Apache-2.0

About rllm

rllm is an open-source AI tool for ai models and llm tooling. It is available on CLI and self-hosted.

rLLM focuses on improving agents by training them, not just running them. A workflow engine runs many parallel agent instances to collect rollouts, a LiteLLM proxy routes requests and captures token IDs and logprobs, a transform pipeline groups trajectories, and a training backend (verl, tinker or fireworks) applies the policy update.

It can wrap CLI harnesses such as Claude Code, Codex and opencode or custom agents in LangGraph and the OpenAI Agents SDK, using sandboxes such as Docker, Daytona, Modal or local. Over 60 benchmarks are integrated, including SWE-bench and Terminal-Bench 2.0, and methods include GRPO, REINFORCE, RLOO and SFT.

The CLI covers model setup, eval, train and project scaffolding. It comes from the Berkeley Sky Computing Lab and is Apache-2.0.

What it does

Any harness
Wrap CLI or custom agents with a decorator.
Switchable backends
verl, tinker or fireworks with one flag.
60+ benchmarks
rllm eval pulls and runs integrated benchmarks.
Several RL methods
GRPO, REINFORCE, RLOO, SFT and distillation.
Sandbox support
Docker, Daytona, Modal or local runs.
CLI workflow
Setup, eval, train and init commands.

Good for

  • Training a coding agent with RL on SWE tasks
  • Evaluating an agent across many benchmarks
  • Switching between single-machine and multi-GPU training
  • Reproducing published agent results

Pricing

Open source

Free, Apache-2.0

Prices change. Check docs.rllm-project.com before you buy.

rllm FAQ

Which training backends?

verl, tinker and fireworks.

Does it need a particular agent framework?

No; it works with any framework with minimal code changes.

Who builds it?

The Berkeley Sky Computing Lab.

Is rllm free?

Yes. rllm is open source, so you can use and self-host it for free.

What are the best alternatives to rllm?

The closest alternatives to rllm are GPT-3 Playground (OpenAI), ChatGPT (OpenAI), to teach, Heyday and ECC.

Alternatives to rllm

  1. Ask any question or prompt to AI - The tool most other writing tools are based on

    • Free
    • Chat
  2. For teachers to create exercises and lessons for their students

    • Freemium
    • Productivity
  3. AI-powered memory assistant

    • Free trial
    • Productivity
  4. Skills, hooks, memory and security layer for coding agent harnesses

    • Freemium
    • Open-source agent
    • 305K GitHub stars
    • AI models and LLM tooling