doc-scraper vs GitHub
doc-scraper is an open-source MCP server for web search and scraping. GitHub is an open-source MCP server for developer tools.
- doc-scraper is best for give a coding agent the exact docs for a library version.
- GitHub is best for triage bugs and issues.
- What it is
- doc-scraper is an open-source MCP server for web search and scraping.GitHub is an open-source MCP server for developer tools.
- Best for
- Give a coding agent the exact docs for a library versionTriage bugs and issues
- Kind
- MCP serverMCP server
- Pricing
- Open sourceOpen source
- Platforms
- CLI, macOS, Windows, Linux, self-hostedAPI, CLI, self-hosted
- Runs
- LocallyLocally or Remotely
- GitHub stars
- 34.5K
- Last commit
- Nov 2026
- License
- MIT
- Open source
- Good for
- Give a coding agent the exact docs for a library version; Keep an offline copy of documentation for air-gapped work; Detect what changed between two crawls of a docs siteTriage bugs and issues; Review pull request changes; Diagnose failed CI runs
What doc-scraper does
Offline BM25 search
search_docs and read_page answer from the stored corpus with no network.
Framework detection
Recognises 30+ docs generators and validates the content selector.
Clean Markdown output
One Markdown file per page plus pages.jsonl, llms.txt and llms-full.txt.
Polite crawling
Honours robots.txt and sitemaps with rate limits, retries and resumable runs.
Freshness tracking
Incremental re-crawls, watch mode and crawl-to-crawl diffs.
Parallel crawls
Runs many sites at once under shared limits.
What GitHub does
Repository access
Browse code, search files and analyze commits.
Issues and PRs
Create, update and manage issues and pull requests.
Actions insight
Monitor workflow runs and analyze build failures.
Security findings
Examine code scanning and Dependabot alerts.
Collaboration
Access discussions and notifications.
Local or remote
OCI image over stdio or a hosted endpoint.
doc-scraper vs GitHub: questions
Is doc-scraper or GitHub cheaper?
Both are open source. Compare current plans on each official site.
What is the difference between doc-scraper and GitHub?
doc-scraper is an open-source MCP server for web search and scraping. GitHub is an open-source MCP server for developer tools.
