
rllm
Reinforcement-learning framework for training language agents on any harness
- Pricing
- Open source
- Platforms
- CLI, self-hosted
- GitHub stars
- 5.9K
- Last commit
- 1 month ago
- Language
- Python
- License
- Apache-2.0
About rllm
rllm is an open-source AI tool for ai models and llm tooling. It is available on CLI and self-hosted.
rLLM focuses on improving agents by training them, not just running them. A workflow engine runs many parallel agent instances to collect rollouts, a LiteLLM proxy routes requests and captures token IDs and logprobs, a transform pipeline groups trajectories, and a training backend (verl, tinker or fireworks) applies the policy update.
It can wrap CLI harnesses such as Claude Code, Codex and opencode or custom agents in LangGraph and the OpenAI Agents SDK, using sandboxes such as Docker, Daytona, Modal or local. Over 60 benchmarks are integrated, including SWE-bench and Terminal-Bench 2.0, and methods include GRPO, REINFORCE, RLOO and SFT.
The CLI covers model setup, eval, train and project scaffolding. It comes from the Berkeley Sky Computing Lab and is Apache-2.0.
What it does
- Any harness
- Wrap CLI or custom agents with a decorator.
- Switchable backends
- verl, tinker or fireworks with one flag.
- 60+ benchmarks
- rllm eval pulls and runs integrated benchmarks.
- Several RL methods
- GRPO, REINFORCE, RLOO, SFT and distillation.
- Sandbox support
- Docker, Daytona, Modal or local runs.
- CLI workflow
- Setup, eval, train and init commands.
Good for
- Training a coding agent with RL on SWE tasks
- Evaluating an agent across many benchmarks
- Switching between single-machine and multi-GPU training
- Reproducing published agent results
Pricing
Open source
Free, Apache-2.0
Prices change. Check docs.rllm-project.com before you buy.
rllm FAQ
Which training backends?
verl, tinker and fireworks.
Does it need a particular agent framework?
No; it works with any framework with minimal code changes.
Who builds it?
The Berkeley Sky Computing Lab.
Is rllm free?
Yes. rllm is open source, so you can use and self-host it for free.
What are the best alternatives to rllm?
The closest alternatives to rllm are GPT-3 Playground (OpenAI), ChatGPT (OpenAI), to teach, Heyday and ECC.
Alternatives to rllm
-icon.png)
Free AI writing tool - Let the AI generate any text you can imagine
- Free
- Copywriting
-icon.jpg)
Ask any question or prompt to AI - The tool most other writing tools are based on
- Free
- Chat



Skills, hooks, memory and security layer for coding agent harnesses
- Freemium
- Open-source agent
- 305K GitHub stars
- AI models and LLM tooling
