Open SEO Crawler
Self-hosted SEO crawler with AI-crawler checks that assistants can drive over MCP
- Pricing
- Open source
- Platforms
- self-hosted, CLI, macOS
- Runs
- Locally
- Version
- 1.0.0
- Listing updated
- 1 day ago
About Open SEO Crawler
Open SEO Crawler is an open-source MCP server for web search and scraping. It runs locally on your machine and is started by your AI client.
Open SEO Crawler is a local website auditing tool, and the MCP server lets an assistant run it. Through MCP or the bundled osc.py command line, an assistant can start a crawl and follow it, read the summary, filter pages by issue, open a single page with its inlinks, compare two crawls, run the AI crawler check on any URL and export to .xlsx. The crawler itself calls no AI.
After each crawl it requests a sample of pages as Googlebot, Bingbot, Applebot and AI crawlers such as GPTBot, OAI-SearchBot, ChatGPT-User, PerplexityBot and CCBot, flagging blocks, challenges, redirects, thinner responses and content that only appears after JavaScript runs.
The README describes it as MIT-licensed with no accounts, API keys, cloud or URL limits, with CMS-aware presets for ten CMSs and optional headless rendering. The MCP server ships as an mcpb bundle and runs over stdio.
Install
Run in a terminal
claude mcp add open-seo-crawler -- npx -y https://github.com/puneetindersingh/open-seo-crawler/releases/download/mcp-v1.0.0/open-seo-crawler-mcp.mcpbAdd to claude_desktop_config.json
{
"mcpServers": {
"open-seo-crawler": {
"command": "npx",
"args": [
"-y",
"https://github.com/puneetindersingh/open-seo-crawler/releases/download/mcp-v1.0.0/open-seo-crawler-mcp.mcpb"
]
}
}
}Add to ~/.cursor/mcp.json
{
"mcpServers": {
"open-seo-crawler": {
"command": "npx",
"args": [
"-y",
"https://github.com/puneetindersingh/open-seo-crawler/releases/download/mcp-v1.0.0/open-seo-crawler-mcp.mcpb"
]
}
}
}Add to .vscode/mcp.json
{
"servers": {
"open-seo-crawler": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"https://github.com/puneetindersingh/open-seo-crawler/releases/download/mcp-v1.0.0/open-seo-crawler-mcp.mcpb"
]
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"open-seo-crawler": {
"command": "npx",
"args": [
"-y",
"https://github.com/puneetindersingh/open-seo-crawler/releases/download/mcp-v1.0.0/open-seo-crawler-mcp.mcpb"
]
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"open-seo-crawler": {
"command": "npx",
"args": [
"-y",
"https://github.com/puneetindersingh/open-seo-crawler/releases/download/mcp-v1.0.0/open-seo-crawler-mcp.mcpb"
]
}
}
}What it does
- AI crawler check
- Requests pages as Googlebot, Bingbot and several AI crawlers to spot blocks and thinner versions.
- Crawl control by MCP
- Start, follow and read crawls from an assistant.
- Issue filtering
- Filter pages by issue and open one page with its inlinks.
- Crawl comparison
- Compare two crawls and export results to .xlsx.
- CMS-aware presets
- Ten CMS presets and optional headless JS rendering.
- Use with AI brief
- Packs a crawl into a Markdown summary and prompt for any assistant.
Good for
- Audit a site for technical SEO issues from chat
- Check whether AI search bots can read key pages
- Compare crawls before and after a release
- Run recurring portfolio-wide site audits
Pricing
Open source
Open SEO Crawler FAQ
Does it need an account or API key?
No. The README says it runs locally with no accounts, API keys or cloud.
Does the crawler use AI itself?
No. Your assistant calls the crawler; the crawler calls no AI.
What licence is it?
The README lists it as MIT.
Is Open SEO Crawler free?
Yes. Open SEO Crawler is open source, so you can use and self-host it for free.
How do I add Open SEO Crawler to Claude Code?
Run this command in your terminal: claude mcp add open-seo-crawler -- npx -y https://github.com/puneetindersingh/open-seo-crawler/releases/download/mcp-v1.0.0/open-seo-crawler-mcp.mcpb
What are the best alternatives to Open SEO Crawler?
The closest alternatives to Open SEO Crawler are Scrapling MCP Server, Firecrawl MCP Server, Google Ads + Meta Ads + SEO/GEO MCP, SearXNG Search and Calven.
Alternatives to Open SEO Crawler

Scrapling MCP Server
MCP serverMCP server for AI clients to scrape sites with HTTP and stealth browser sessions
Runs locally- 17 tools
- Open source
- 104K GitHub stars
- Web search and scraping

Firecrawl MCP Server
MCP serverMCP server that lets AI agents search, scrape and interact with web pages
- 3 tools
- Remote
- Freemium
- 7.8K GitHub stars
- Web search and scraping

Google Ads + Meta Ads + SEO/GEO MCP
MCP serverHosted MCP connector for managing Google Ads, Meta Ads, GA4 and Search Console from chat
- 8 tools
- Remote
- Freemium
- 8.1K GitHub stars
- Marketing and SEO

SearXNG Search
MCP serverMCP server for web search and page reading through a SearXNG instance
Runs locally- 3 tools
- Open source
- 1.4K GitHub stars
- Web search and scraping

Calven
MCP serverProduct marketing context from Calven delivered into Claude, ChatGPT and other AI tools
Not checked yet- Remote
- Free trial
- 3 GitHub stars
- Marketing and SEO

NeuralVerge
MCP serverStructured, source-tagged business and people data from 300+ sources for agents
- 200 tools
- Remote
- Free trial
- 1 GitHub star
- Web search and scraping