Search that shows its work vs ShadowCrawl
Search that shows its work is an open-source MCP server for web search and scraping. ShadowCrawl is an open-source MCP server for web search and scraping.
- Search that shows its work is best for giving an ai assistant web search that reports when results are unreliable.
- ShadowCrawl is best for giving a coding agent live web search and page extraction inside an ide.
- What it is
- Search that shows its work is an open-source MCP server for web search and scraping.ShadowCrawl is an open-source MCP server for web search and scraping.
- Best for
- Giving an AI assistant web search that reports when results are unreliableGiving a coding agent live web search and page extraction inside an IDE
- Kind
- MCP serverMCP server
- Pricing
- Open sourceOpen source
- Platforms
- API, CLI, self-hostedCLI, self-hosted, API, vscode, macOS, Linux, Windows
- Open source
- Good for
- Giving an AI assistant web search that reports when results are unreliable; Reading and summarising specific web pages or PDFs from an MCP client; Running a private search backend without sending queries to a hosted search APIGiving a coding agent live web search and page extraction inside an IDE; Scraping protected listing or job pages that block plain HTTP requests; Running UI or end-to-end test flows with route mocks and trace export through an agent
What Search that shows its work does
Explicit failure fields
Engine refusals, silent empty results and irrelevant answers are reported in a trouble object instead of passing as success.
Search with optional page reading
One call returns links and can also read the top results, with a flag to skip reading when only links are needed.
Page reading with browser mode
Reads pages as text, PDFs or scanned documents, and can use a sandboxed browser for JavaScript-rendered pages.
Screenshots with matching text
Returns a PNG of a page together with the text from the same visit so the two can be compared.
Caller access tokens
Optional token list with per-tool scopes controls which clients may call which tools.
Robots.txt reporting
Reports whether a site's rules allow a path, disallow it, or could not be checked, without enforcing them.
What ShadowCrawl does
Multi-engine web search
Queries several search engines, merges and deduplicates results, and can return page content in the same call.
Staged anti-bot fallbacks
Moves from native fetching to CDP rendering and block-aware retries before escalating to a human-assisted browser.
Stateful browser automation
Runs Playwright-style action arrays in one omni-tool with a persistent profile that keeps cookies and session state.
Human-in-the-loop auth
Opens the agent's profile in a visible window so a person can complete CAPTCHAs or OAuth logins once.
Structured extraction and research
Extracts fields from pages and runs multi-hop deep research with optional LLM synthesis via OpenAI-compatible endpoints.
Research memory
Stores past research in a LanceDB-backed local store that agents can search before fetching live pages.
Search that shows its work vs ShadowCrawl: questions
Is Search that shows its work or ShadowCrawl cheaper?
Both are open source. Compare current plans on each official site.
What is the difference between Search that shows its work and ShadowCrawl?
Search that shows its work is an open-source MCP server for web search and scraping. ShadowCrawl is an open-source MCP server for web search and scraping.