Skip to content

doc-scraper vs XERJ

doc-scraper is an open-source MCP server for web search and scraping. XERJ is an open-source MCP server for knowledge and memory.

  • doc-scraper is best for give a coding agent the exact docs for a library version.
  • XERJ is best for search local code and docs from an agent.
What it is
doc-scraper is an open-source MCP server for web search and scraping.
XERJ is an open-source MCP server for knowledge and memory.
Best for
Give a coding agent the exact docs for a library version
Search local code and docs from an agent
Kind
MCP server
MCP server
Pricing
Open source
Open source
Platforms
CLI, macOS, Windows, Linux, self-hosted
CLI, Linux, macOS, self-hosted, API
Runs
Locally
Locally
GitHub stars
19.2K
Last commit
Nov 2026
License
Apache-2.0
Open source
Good for
Give a coding agent the exact docs for a library version; Keep an offline copy of documentation for air-gapped work; Detect what changed between two crawls of a docs site
Search local code and docs from an agent; Give an agent persistent memory notes; Look up real API definitions

What doc-scraper does

  • Offline BM25 search

    search_docs and read_page answer from the stored corpus with no network.

  • Framework detection

    Recognises 30+ docs generators and validates the content selector.

  • Clean Markdown output

    One Markdown file per page plus pages.jsonl, llms.txt and llms-full.txt.

  • Polite crawling

    Honours robots.txt and sitemaps with rate limits, retries and resumable runs.

  • Freshness tracking

    Incremental re-crawls, watch mode and crawl-to-crawl diffs.

  • Parallel crawls

    Runs many sites at once under shared limits.

What XERJ does

  • Single binary

    Search, vectors, facts and memory in one Rust program.

  • Evidence-backed answers

    Answers come with the program and evidence used.

  • Runs locally

    Works offline on a CPU, on a laptop or server.

  • Elasticsearch-compatible API

    Exposes an API compatible with Elasticsearch.

  • Reference coding

    Index open-source repos so agents consult real definitions.

  • MCP integration

    Stdio MCP server connects to a running node.

doc-scraper vs XERJ: questions

Is doc-scraper or XERJ cheaper?

Both are open source. Compare current plans on each official site.

What is the difference between doc-scraper and XERJ?

doc-scraper is an open-source MCP server for web search and scraping. XERJ is an open-source MCP server for knowledge and memory.