acrawl vs ShadowCrawl
acrawl is an open-source MCP server for browser automation. ShadowCrawl is an open-source MCP server for web search and scraping.
- acrawl is best for scrape a product catalogue into json.
- ShadowCrawl is best for giving a coding agent live web search and page extraction inside an ide.
- What it is
- acrawl is an open-source MCP server for browser automation.ShadowCrawl is an open-source MCP server for web search and scraping.
- Best for
- Scrape a product catalogue into JSONGiving a coding agent live web search and page extraction inside an IDE
- Kind
- MCP serverMCP server
- Pricing
- Open sourceOpen source
- Platforms
- CLI, macOS, Linux, Windows, Chrome extensionCLI, self-hosted, API, vscode, macOS, Linux, Windows
- Runs
- Locally
- GitHub stars
- 16
- Last commit
- Nov 2026
- License
- MIT
- Open source
- Good for
- Scrape a product catalogue into JSON; Debug failed requests on a local checkout page; Run an accessibility auditGiving a coding agent live web search and page extraction inside an IDE; Scraping protected listing or job pages that block plain HTTP requests; Running UI or end-to-end test flows with route mocks and trace export through an agent
What acrawl does
Goal-driven scraping
Describe fields and let the agent handle pagination.
DevTools tools
Network, console, performance and accessibility inspection.
Replayable scripts
Save a crawl as JSON and rerun without an LLM.
25 model providers
Anthropic, OpenAI, Gemini, Ollama and more.
Parallel tabs
Sub-agents split large jobs without duplicate pages.
Own-browser bridge
An extension lets it work in your logged-in Chrome.
What ShadowCrawl does
Multi-engine web search
Queries several search engines, merges and deduplicates results, and can return page content in the same call.
Staged anti-bot fallbacks
Moves from native fetching to CDP rendering and block-aware retries before escalating to a human-assisted browser.
Stateful browser automation
Runs Playwright-style action arrays in one omni-tool with a persistent profile that keeps cookies and session state.
Human-in-the-loop auth
Opens the agent's profile in a visible window so a person can complete CAPTCHAs or OAuth logins once.
Structured extraction and research
Extracts fields from pages and runs multi-hop deep research with optional LLM synthesis via OpenAI-compatible endpoints.
Research memory
Stores past research in a LanceDB-backed local store that agents can search before fetching live pages.
acrawl vs ShadowCrawl: questions
Is acrawl or ShadowCrawl cheaper?
Both are open source. Compare current plans on each official site.
What is the difference between acrawl and ShadowCrawl?
acrawl is an open-source MCP server for browser automation. ShadowCrawl is an open-source MCP server for web search and scraping.