# RAG Documentation Scraper

> RAG Documentation Scraper is an open-source MCP server for web search and scraping. Crawl any documentation site and return heading-bounded, LLM-ready chunks with source metadata. It runs locally on your machine and is started by your AI client.

- **Kind:** MCP server
- **Pricing:** Open source
- **Repository:** https://github.com/lernowaadmin/rag-docs-scraper
- **MCP Registry name:** io.github.LernowaAdmin/rag-docs-scraper
- **Categories:** web search and scraping, knowledge and memory
- **Listing updated:** 2026-11-13

## About

Crawl any documentation site and return heading-bounded, LLM-ready chunks with source metadata.

## Install

### Claude Code (Terminal)

```sh
claude mcp add rag-docs-scraper --env APIFY_TOKEN='<APIFY_TOKEN>' -- npx -y rag-docs-scraper-mcp-server
```

### Claude Desktop (claude_desktop_config.json)

```json
{
  "mcpServers": {
    "rag-docs-scraper": {
      "command": "npx",
      "args": [
        "-y",
        "rag-docs-scraper-mcp-server"
      ],
      "env": {
        "APIFY_TOKEN": "<APIFY_TOKEN>"
      }
    }
  }
}
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "rag-docs-scraper": {
      "command": "npx",
      "args": [
        "-y",
        "rag-docs-scraper-mcp-server"
      ],
      "env": {
        "APIFY_TOKEN": "<APIFY_TOKEN>"
      }
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "rag-docs-scraper": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "rag-docs-scraper-mcp-server"
      ],
      "env": {
        "APIFY_TOKEN": "<APIFY_TOKEN>"
      }
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "rag-docs-scraper": {
      "command": "npx",
      "args": [
        "-y",
        "rag-docs-scraper-mcp-server"
      ],
      "env": {
        "APIFY_TOKEN": "<APIFY_TOKEN>"
      }
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "rag-docs-scraper": {
      "command": "npx",
      "args": [
        "-y",
        "rag-docs-scraper-mcp-server"
      ],
      "env": {
        "APIFY_TOKEN": "<APIFY_TOKEN>"
      }
    }
  }
}
```

## FAQ

### Is RAG Documentation Scraper free?

Yes. RAG Documentation Scraper is open source, so you can use and self-host it for free.

### How do I add RAG Documentation Scraper to Claude Code?

Run this command in your terminal: claude mcp add rag-docs-scraper --env APIFY_TOKEN='<APIFY_TOKEN>' -- npx -y rag-docs-scraper-mcp-server

### What are the best alternatives to RAG Documentation Scraper?

The closest alternatives to RAG Documentation Scraper are Scrapling MCP Server, Codebase Memory, XERJ, Firecrawl MCP Server and Claude Code Ultimate Guide.

## Alternatives

- [Scrapling MCP Server](https://ai-powered.com/mcp/scrapling-mcp-server): Scrapling MCP Server is an open-source MCP server for web search and scraping.
- [Codebase Memory](https://ai-powered.com/mcp/codebase-memory): Codebase Memory is an open-source MCP server for knowledge and memory.
- [XERJ](https://ai-powered.com/mcp/xerj): XERJ is an open-source MCP server for knowledge and memory.
- [Firecrawl MCP Server](https://ai-powered.com/mcp/firecrawl-mcp-server): Firecrawl MCP Server is a freemium MCP server for web search and scraping.
- [Claude Code Ultimate Guide](https://ai-powered.com/mcp/claude-code-ultimate-guide): Claude Code Ultimate Guide is an open-source MCP server for ai models and llm tooling.
- [SearXNG Search](https://ai-powered.com/mcp/searxng-search): SearXNG Search is an open-source MCP server for web search and scraping.
- [Nautilus Compass Memory](https://ai-powered.com/mcp/nautilus-compass-memory): Nautilus Compass Memory is an open-source MCP server for knowledge and memory.
- [note1](https://ai-powered.com/mcp/note1): note1 is an MCP server for productivity.

---
Source: https://ai-powered.com/mcp/rag-documentation-scraper
