Skip to content

doc-scraper vs GitHub

doc-scraper is an open-source MCP server for web search and scraping. GitHub is an open-source MCP server for developer tools.

  • doc-scraper is best for give a coding agent the exact docs for a library version.
  • GitHub is best for triage bugs and issues.
What it is
doc-scraper is an open-source MCP server for web search and scraping.
GitHub is an open-source MCP server for developer tools.
Best for
Give a coding agent the exact docs for a library version
Triage bugs and issues
Kind
MCP server
MCP server
Pricing
Open source
Open source
Platforms
CLI, macOS, Windows, Linux, self-hosted
API, CLI, self-hosted
Runs
Locally
Locally or Remotely
GitHub stars
34.5K
Last commit
Nov 2026
License
MIT
Open source
Good for
Give a coding agent the exact docs for a library version; Keep an offline copy of documentation for air-gapped work; Detect what changed between two crawls of a docs site
Triage bugs and issues; Review pull request changes; Diagnose failed CI runs

What doc-scraper does

  • Offline BM25 search

    search_docs and read_page answer from the stored corpus with no network.

  • Framework detection

    Recognises 30+ docs generators and validates the content selector.

  • Clean Markdown output

    One Markdown file per page plus pages.jsonl, llms.txt and llms-full.txt.

  • Polite crawling

    Honours robots.txt and sitemaps with rate limits, retries and resumable runs.

  • Freshness tracking

    Incremental re-crawls, watch mode and crawl-to-crawl diffs.

  • Parallel crawls

    Runs many sites at once under shared limits.

What GitHub does

  • Repository access

    Browse code, search files and analyze commits.

  • Issues and PRs

    Create, update and manage issues and pull requests.

  • Actions insight

    Monitor workflow runs and analyze build failures.

  • Security findings

    Examine code scanning and Dependabot alerts.

  • Collaboration

    Access discussions and notifications.

  • Local or remote

    OCI image over stdio or a hosted endpoint.

doc-scraper vs GitHub: questions

Is doc-scraper or GitHub cheaper?

Both are open source. Compare current plans on each official site.

What is the difference between doc-scraper and GitHub?

doc-scraper is an open-source MCP server for web search and scraping. GitHub is an open-source MCP server for developer tools.