# ClawBench

> ClawBench is an open-source AI tool for browser automation. Benchmark scoring browser agents on 130 real tasks across live websites. It is available on CLI and Web.

- **Kind:** Tool
- **Pricing:** Open source
- **Platforms:** CLI, Web
- **Website:** https://claw-bench.com
- **Repository:** https://github.com/tiger-ai-lab/clawbench
- **GitHub stars:** 1,307
- **License:** Apache-2.0
- **Categories:** browser automation, research
- **Listing updated:** 2026-11-14

## About

The benchmark gives agents everyday jobs such as booking flights, ordering food and applying for jobs, and checks if they submit the right thing. Scoring has two stages: the final HTTP request is intercepted and matched to the task schema, then an LLM judge compares the payload to the instruction.

V2 has 130 tasks over 63 platforms in 30 categories, V1 has 153 tasks. The leaderboard (as of 2026-05-20) shows claude-opus-4-7 on top at 54.6 percent intercepted for V2 with the hermes harness, and cost per task is reported.

To run it yourself: pip install clawbench-eval. Apache-2.0.

## Features

- **Live websites:** Tasks run on real platforms.
- **Two-stage scoring:** HTTP interception then LLM judge.
- **V1 and V2 corpora:** 153 and 130 tasks.
- **Leaderboard:** Reward, intercepted rate, cost per task.
- **CLI runner:** pip install clawbench-eval.

## Good for

- Compare models as browser agents
- Measure harness changes
- Reproduce leaderboard runs

## FAQ

### How is a task scored?

The final request is intercepted and then judged by an LLM.

### How do I run it?

pip install clawbench-eval, then clawbench run.

### Is ClawBench free?

Yes. ClawBench is open source, so you can use and self-host it for free.

### What are the best alternatives to ClawBench?

The closest alternatives to ClawBench are GPT-3 Playground (OpenAI), ChatGPT (OpenAI), to teach, Heyday and Teach Anything.

## Alternatives

- [GPT-3 Playground (OpenAI)](https://ai-powered.com/tools/gpt-3_playground_(openai)): GPT-3 Playground (OpenAI) is a free AI tool for copywriting.
- [ChatGPT (OpenAI)](https://ai-powered.com/tools/chatgpt_(openai)): ChatGPT (OpenAI) is a free AI tool for chat.
- [to teach](https://ai-powered.com/tools/to_teach): to teach is a freemium AI tool for productivity.
- [Heyday](https://ai-powered.com/tools/heyday): Heyday is an AI tool for productivity.
- [Teach Anything](https://ai-powered.com/tools/teach_anything): Teach Anything is a free AI tool for research.
- [Perplexity AI](https://ai-powered.com/tools/perplexity_ai): Perplexity AI is a free AI tool for chat.
- [TutorAI](https://ai-powered.com/tools/tutorai): TutorAI is a free AI tool for research.
- [Venturefy](https://ai-powered.com/tools/venturefy): Venturefy is an AI tool for research.

---
Source: https://ai-powered.com/tools/clawbench
