# acrawl

> acrawl is an open-source MCP server for browser automation. Rust browser agent that scrapes, debugs and replays crawls, usable as an MCP server. It runs locally on your machine and is started by your AI client.

- **Kind:** MCP server
- **Pricing:** Open source
- **Platforms:** CLI, macOS, Linux, Windows, Chrome extension
- **Repository:** https://github.com/mingye-lu/agenticcrawler
- **GitHub stars:** 16
- **License:** MIT
- **MCP Registry name:** io.github.Mingye-Lu/acrawl
- **Categories:** [browser automation](https://ai-powered.com/categories/browser-automation), [web search and scraping](https://ai-powered.com/categories/web-search-and-scraping)
- **Listing updated:** 2026-11-18

## About

Acrawl is a single Rust binary with a goal-driven agent. You tell it what you want, for example every book title and price across 50 pages, and it works out pagination and returns JSON. It fetches static pages over HTTP and switches to a real stealth browser only when a page needs JavaScript.

Unlike most browser agents, it can also observe: network requests, console logs, WebSocket frames, performance timings, cookies, storage, code coverage and axe-core accessibility audits are all tools. The README counts 43 tools and 25 LLM providers, including Anthropic, OpenAI, Gemini and local Ollama.

A finished crawl can be saved as a JSON script with loops and conditions, then replayed from cron or CI with no model calls. In MCP mode it exposes its tools to clients such as Claude Code, Cursor and VS Code, and it can fork sub-agents onto separate tabs. It is MIT-licensed, runs locally with your own key and has no telemetry.

## Features

- **Goal-driven scraping:** Describe fields and let the agent handle pagination.
- **DevTools tools:** Network, console, performance and accessibility inspection.
- **Replayable scripts:** Save a crawl as JSON and rerun without an LLM.
- **25 model providers:** Anthropic, OpenAI, Gemini, Ollama and more.
- **Parallel tabs:** Sub-agents split large jobs without duplicate pages.
- **Own-browser bridge:** An extension lets it work in your logged-in Chrome.

## Good for

- Scrape a product catalogue into JSON
- Debug failed requests on a local checkout page
- Run an accessibility audit
- Schedule a repeat crawl from CI

## Install

### Claude Code (Terminal)

```sh
claude mcp add acrawl -- npx -y https://github.com/Mingye-Lu/AgenticCrawler/releases/download/v0.17.0/acrawl-mcp-linux-x64.mcpb
```

### Claude Desktop (claude_desktop_config.json)

```json
{
  "mcpServers": {
    "acrawl": {
      "command": "npx",
      "args": [
        "-y",
        "https://github.com/Mingye-Lu/AgenticCrawler/releases/download/v0.17.0/acrawl-mcp-linux-x64.mcpb"
      ]
    }
  }
}
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "acrawl": {
      "command": "npx",
      "args": [
        "-y",
        "https://github.com/Mingye-Lu/AgenticCrawler/releases/download/v0.17.0/acrawl-mcp-linux-x64.mcpb"
      ]
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "acrawl": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "https://github.com/Mingye-Lu/AgenticCrawler/releases/download/v0.17.0/acrawl-mcp-linux-x64.mcpb"
      ]
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "acrawl": {
      "command": "npx",
      "args": [
        "-y",
        "https://github.com/Mingye-Lu/AgenticCrawler/releases/download/v0.17.0/acrawl-mcp-linux-x64.mcpb"
      ]
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "acrawl": {
      "command": "npx",
      "args": [
        "-y",
        "https://github.com/Mingye-Lu/AgenticCrawler/releases/download/v0.17.0/acrawl-mcp-linux-x64.mcpb"
      ]
    }
  }
}
```

## Tools

- `run_goal`: Run a goal-driven agent over the browser.

## FAQ

### Which licence?

MIT.

### Does it need Python or Docker?

No. It is one binary; Node.js 20 or newer is needed for the bundled browser.

### Can it run without an LLM?

Saved scripts replay with no model calls.

### Does it collect telemetry?

The README says no telemetry.

### Is acrawl free?

Yes. acrawl is open source, so you can use and self-host it for free.

### How do I add acrawl to Claude Code?

Run this command in your terminal: claude mcp add acrawl -- npx -y https://github.com/Mingye-Lu/AgenticCrawler/releases/download/v0.17.0/acrawl-mcp-linux-x64.mcpb

### What are the best alternatives to acrawl?

The closest alternatives to acrawl are Browser Use, Scrapling MCP Server, Chrome DevTools MCP, Firecrawl MCP Server and Douyin_TikTok_Download_API.

## Where this comes from

- Description: written from the project's README.
- Install steps: from the official MCP Registry entry.

## Alternatives

- [Browser Use](https://ai-powered.com/mcp/browser-use): Browser Use is a freemium MCP server for browser automation.
- [Scrapling MCP Server](https://ai-powered.com/mcp/scrapling-mcp-server): Scrapling MCP Server is an open-source MCP server for web search and scraping.
- [Chrome DevTools MCP](https://ai-powered.com/mcp/chrome-devtools-mcp-2): Chrome DevTools MCP is an open-source MCP server for browser automation.
- [Firecrawl MCP Server](https://ai-powered.com/mcp/firecrawl-mcp-server): Firecrawl MCP Server is a freemium MCP server for web search and scraping.
- [Douyin_TikTok_Download_API](https://ai-powered.com/mcp/douyin-tiktok-download-api): Douyin_TikTok_Download_API is an open-source MCP server for web search and scraping.
- [SearXNG Search](https://ai-powered.com/mcp/searxng-search): SearXNG Search is an open-source MCP server for web search and scraping.
- [Oya Browser](https://ai-powered.com/mcp/oya-browser): Oya Browser is a freemium MCP server for browser automation.
- [playwright_mcp](https://ai-powered.com/mcp/playwright-mcp-3): playwright_mcp is an open-source MCP server for browser automation.

---
Source: https://ai-powered.com/mcp/acrawl
