Skip to content
MCP server

Open SEO Crawler

Self-hosted SEO crawler with AI-crawler checks that assistants can drive over MCP

Runs locallyStatus and history
Pricing
Open source
Platforms
self-hosted, CLI, macOS
Runs
Locally
Version
1.0.0
Listing updated
1 day ago

About Open SEO Crawler

Open SEO Crawler is an open-source MCP server for web search and scraping. It runs locally on your machine and is started by your AI client.

Open SEO Crawler is a local website auditing tool, and the MCP server lets an assistant run it. Through MCP or the bundled osc.py command line, an assistant can start a crawl and follow it, read the summary, filter pages by issue, open a single page with its inlinks, compare two crawls, run the AI crawler check on any URL and export to .xlsx. The crawler itself calls no AI.

After each crawl it requests a sample of pages as Googlebot, Bingbot, Applebot and AI crawlers such as GPTBot, OAI-SearchBot, ChatGPT-User, PerplexityBot and CCBot, flagging blocks, challenges, redirects, thinner responses and content that only appears after JavaScript runs.

The README describes it as MIT-licensed with no accounts, API keys, cloud or URL limits, with CMS-aware presets for ten CMSs and optional headless rendering. The MCP server ships as an mcpb bundle and runs over stdio.

Install

Run in a terminal

claude mcp add open-seo-crawler -- npx -y https://github.com/puneetindersingh/open-seo-crawler/releases/download/mcp-v1.0.0/open-seo-crawler-mcp.mcpb

Add to claude_desktop_config.json

{
  "mcpServers": {
    "open-seo-crawler": {
      "command": "npx",
      "args": [
        "-y",
        "https://github.com/puneetindersingh/open-seo-crawler/releases/download/mcp-v1.0.0/open-seo-crawler-mcp.mcpb"
      ]
    }
  }
}
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "open-seo-crawler": {
      "command": "npx",
      "args": [
        "-y",
        "https://github.com/puneetindersingh/open-seo-crawler/releases/download/mcp-v1.0.0/open-seo-crawler-mcp.mcpb"
      ]
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "open-seo-crawler": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "https://github.com/puneetindersingh/open-seo-crawler/releases/download/mcp-v1.0.0/open-seo-crawler-mcp.mcpb"
      ]
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "open-seo-crawler": {
      "command": "npx",
      "args": [
        "-y",
        "https://github.com/puneetindersingh/open-seo-crawler/releases/download/mcp-v1.0.0/open-seo-crawler-mcp.mcpb"
      ]
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "open-seo-crawler": {
      "command": "npx",
      "args": [
        "-y",
        "https://github.com/puneetindersingh/open-seo-crawler/releases/download/mcp-v1.0.0/open-seo-crawler-mcp.mcpb"
      ]
    }
  }
}

What it does

AI crawler check
Requests pages as Googlebot, Bingbot and several AI crawlers to spot blocks and thinner versions.
Crawl control by MCP
Start, follow and read crawls from an assistant.
Issue filtering
Filter pages by issue and open one page with its inlinks.
Crawl comparison
Compare two crawls and export results to .xlsx.
CMS-aware presets
Ten CMS presets and optional headless JS rendering.
Use with AI brief
Packs a crawl into a Markdown summary and prompt for any assistant.

Good for

  • Audit a site for technical SEO issues from chat
  • Check whether AI search bots can read key pages
  • Compare crawls before and after a release
  • Run recurring portfolio-wide site audits

Pricing

Open source

Open SEO Crawler FAQ

Does it need an account or API key?

No. The README says it runs locally with no accounts, API keys or cloud.

Does the crawler use AI itself?

No. Your assistant calls the crawler; the crawler calls no AI.

What licence is it?

The README lists it as MIT.

Is Open SEO Crawler free?

Yes. Open SEO Crawler is open source, so you can use and self-host it for free.

How do I add Open SEO Crawler to Claude Code?

Run this command in your terminal: claude mcp add open-seo-crawler -- npx -y https://github.com/puneetindersingh/open-seo-crawler/releases/download/mcp-v1.0.0/open-seo-crawler-mcp.mcpb

What are the best alternatives to Open SEO Crawler?

The closest alternatives to Open SEO Crawler are Scrapling MCP Server, Firecrawl MCP Server, Google Ads + Meta Ads + SEO/GEO MCP, SearXNG Search and Calven.

Alternatives to Open SEO Crawler

  1. MCP server for AI clients to scrape sites with HTTP and stealth browser sessions

    Runs locally
    • 17 tools
    • Open source
    • 104K GitHub stars
    • Web search and scraping
  2. MCP server that lets AI agents search, scrape and interact with web pages

    • 3 tools
    • Remote
    • Freemium
    • 7.8K GitHub stars
    • Web search and scraping
  3. Hosted MCP connector for managing Google Ads, Meta Ads, GA4 and Search Console from chat

    • 8 tools
    • Remote
    • Freemium
    • 8.1K GitHub stars
    • Marketing and SEO
  4. SearXNG Search

    MCP server

    MCP server for web search and page reading through a SearXNG instance

    Runs locally
    • 3 tools
    • Open source
    • 1.4K GitHub stars
    • Web search and scraping
  5. Calven

    MCP server

    Product marketing context from Calven delivered into Claude, ChatGPT and other AI tools

    Not checked yet
    • Remote
    • Free trial
    • 3 GitHub stars
    • Marketing and SEO
  6. NeuralVerge

    MCP server

    Structured, source-tagged business and people data from 300+ sources for agents

    • 200 tools
    • Remote
    • Free trial
    • 1 GitHub star
    • Web search and scraping