doc-scraper vs XERJ
doc-scraper is an open-source MCP server for web search and scraping. XERJ is an open-source MCP server for knowledge and memory.
- doc-scraper is best for give a coding agent the exact docs for a library version.
- XERJ is best for search local code and docs from an agent.
- What it is
- doc-scraper is an open-source MCP server for web search and scraping.XERJ is an open-source MCP server for knowledge and memory.
- Best for
- Give a coding agent the exact docs for a library versionSearch local code and docs from an agent
- Kind
- MCP serverMCP server
- Pricing
- Open sourceOpen source
- Platforms
- CLI, macOS, Windows, Linux, self-hostedCLI, Linux, macOS, self-hosted, API
- Runs
- LocallyLocally
- GitHub stars
- 19.2K
- Last commit
- Nov 2026
- License
- Apache-2.0
- Open source
- Good for
- Give a coding agent the exact docs for a library version; Keep an offline copy of documentation for air-gapped work; Detect what changed between two crawls of a docs siteSearch local code and docs from an agent; Give an agent persistent memory notes; Look up real API definitions
What doc-scraper does
Offline BM25 search
search_docs and read_page answer from the stored corpus with no network.
Framework detection
Recognises 30+ docs generators and validates the content selector.
Clean Markdown output
One Markdown file per page plus pages.jsonl, llms.txt and llms-full.txt.
Polite crawling
Honours robots.txt and sitemaps with rate limits, retries and resumable runs.
Freshness tracking
Incremental re-crawls, watch mode and crawl-to-crawl diffs.
Parallel crawls
Runs many sites at once under shared limits.
What XERJ does
Single binary
Search, vectors, facts and memory in one Rust program.
Evidence-backed answers
Answers come with the program and evidence used.
Runs locally
Works offline on a CPU, on a laptop or server.
Elasticsearch-compatible API
Exposes an API compatible with Elasticsearch.
Reference coding
Index open-source repos so agents consult real definitions.
MCP integration
Stdio MCP server connects to a running node.
doc-scraper vs XERJ: questions
Is doc-scraper or XERJ cheaper?
Both are open source. Compare current plans on each official site.
What is the difference between doc-scraper and XERJ?
doc-scraper is an open-source MCP server for web search and scraping. XERJ is an open-source MCP server for knowledge and memory.
