Skip to content

Search that shows its work vs ShadowCrawl

Search that shows its work is an open-source MCP server for web search and scraping. ShadowCrawl is an open-source MCP server for web search and scraping.

  • Search that shows its work is best for giving an ai assistant web search that reports when results are unreliable.
  • ShadowCrawl is best for giving a coding agent live web search and page extraction inside an ide.
What it is
Search that shows its work is an open-source MCP server for web search and scraping.
ShadowCrawl is an open-source MCP server for web search and scraping.
Best for
Giving an AI assistant web search that reports when results are unreliable
Giving a coding agent live web search and page extraction inside an IDE
Kind
MCP server
MCP server
Pricing
Open source
Open source
Platforms
API, CLI, self-hosted
CLI, self-hosted, API, vscode, macOS, Linux, Windows
Open source
Good for
Giving an AI assistant web search that reports when results are unreliable; Reading and summarising specific web pages or PDFs from an MCP client; Running a private search backend without sending queries to a hosted search API
Giving a coding agent live web search and page extraction inside an IDE; Scraping protected listing or job pages that block plain HTTP requests; Running UI or end-to-end test flows with route mocks and trace export through an agent

What Search that shows its work does

  • Explicit failure fields

    Engine refusals, silent empty results and irrelevant answers are reported in a trouble object instead of passing as success.

  • Search with optional page reading

    One call returns links and can also read the top results, with a flag to skip reading when only links are needed.

  • Page reading with browser mode

    Reads pages as text, PDFs or scanned documents, and can use a sandboxed browser for JavaScript-rendered pages.

  • Screenshots with matching text

    Returns a PNG of a page together with the text from the same visit so the two can be compared.

  • Caller access tokens

    Optional token list with per-tool scopes controls which clients may call which tools.

  • Robots.txt reporting

    Reports whether a site's rules allow a path, disallow it, or could not be checked, without enforcing them.

What ShadowCrawl does

  • Multi-engine web search

    Queries several search engines, merges and deduplicates results, and can return page content in the same call.

  • Staged anti-bot fallbacks

    Moves from native fetching to CDP rendering and block-aware retries before escalating to a human-assisted browser.

  • Stateful browser automation

    Runs Playwright-style action arrays in one omni-tool with a persistent profile that keeps cookies and session state.

  • Human-in-the-loop auth

    Opens the agent's profile in a visible window so a person can complete CAPTCHAs or OAuth logins once.

  • Structured extraction and research

    Extracts fields from pages and runs multi-hop deep research with optional LLM synthesis via OpenAI-compatible endpoints.

  • Research memory

    Stores past research in a LanceDB-backed local store that agents can search before fetching live pages.

Search that shows its work vs ShadowCrawl: questions

Is Search that shows its work or ShadowCrawl cheaper?

Both are open source. Compare current plans on each official site.

What is the difference between Search that shows its work and ShadowCrawl?

Search that shows its work is an open-source MCP server for web search and scraping. ShadowCrawl is an open-source MCP server for web search and scraping.

Keep comparing