AI Bot Access Checker
Test whether GPTBot, ClaudeBot, PerplexityBot and 10 more crawlers can reach a page
Answered our latest tool-list check 22 hours ago with 1 tools. It will be marked verified after 3 successful checks in 7 days.
- Pricing
- Free
- Platforms
- API, Web
- Runs
- Remotely
- Version
- 1.3.0
- Listing updated
- 3 days ago
About AI Bot Access Checker
AI Bot Access Checker is a free MCP server for marketing and seo. It runs as a hosted remote server, so there is nothing to install locally.
The check goes beyond reading robots.txt. For each of 13 bots it finds the applicable rule following RFC 9309, then requests the page with that bot's own User-Agent and compares the response with a normal browser's. That second step catches blocks applied by a firewall or CDN even when robots.txt allows the bot, and results distinguish being blocked by robots from being blocked by the server.
The page groups crawlers into search crawlers that build the index AI answers cite, user-triggered fetchers that open a page live, and training crawlers, and notes that blocking one kind does not block the others. It shows, per AI engine, whether the page can be found, opened live and used for training.
The server exposes one tool, check_ai_bot_access, over streamable HTTP. It is free, needs no key and uses an MIT licence. The author states that access is only the first step and does not decide whether AI answers cite a page.
Install
Run in a terminal
claude mcp add --transport http ai-bot-access-checker https://tools.seopaslaugos.io/mcpAdd to Settings → Connectors → Add custom connector
https://tools.seopaslaugos.io/mcpAdd to ~/.cursor/mcp.json
{
"mcpServers": {
"ai-bot-access-checker": {
"url": "https://tools.seopaslaugos.io/mcp"
}
}
}Add to .vscode/mcp.json
{
"servers": {
"ai-bot-access-checker": {
"type": "http",
"url": "https://tools.seopaslaugos.io/mcp"
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"ai-bot-access-checker": {
"serverUrl": "https://tools.seopaslaugos.io/mcp"
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"ai-bot-access-checker": {
"type": "http",
"url": "https://tools.seopaslaugos.io/mcp"
}
}
}Tools this server provides (1)
Read directly from the server.
- check_ai_bot_access
- Checks whether AI crawlers and search bots (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-User, PerplexityBot, Perplexity-User, Googlebot, Google-Extended, bingbot, Applebot-Extended, CCBot) can reach a page. For each bot it reports the robots.txt rule that applies and whether the server or firewall blocks that User-Agent (403, 429, dropped connection, challenge or captc
What it does
- 13 bot checks
- Covers OpenAI, Anthropic, Perplexity, Google and Bing crawlers.
- robots.txt per RFC 9309
- Finds the rule that applies to each bot.
- Real User-Agent requests
- Detects firewall and CDN blocks.
- Per-engine view
- Shows find, open live and training access.
- Free and keyless
- No sign-up, MIT licence.
Good for
- Confirm your site is open to AI search crawlers
- Debug a firewall that blocks ClaudeBot
- Audit robots.txt before changing training opt-outs
- Add a crawler check to an SEO audit
Pricing
Free
Prices change. Check seopaslaugos.io before you buy.
AI Bot Access Checker FAQ
Does it need an API key?
No. It is free with no key.
Can a page be allowed in robots.txt and still blocked?
Yes. That is why it also requests the page as each bot.
Does access guarantee AI citations?
No. The page says access is the first requirement, not the last.
Is AI Bot Access Checker free?
Yes. AI Bot Access Checker is free to use.
How do I add AI Bot Access Checker to Claude Code?
Run this command in your terminal: claude mcp add --transport http ai-bot-access-checker https://tools.seopaslaugos.io/mcp
What are the best alternatives to AI Bot Access Checker?
The closest alternatives to AI Bot Access Checker are Scrapling MCP Server, Firecrawl MCP Server, Google Ads + Meta Ads + SEO/GEO MCP, SearXNG Search and Calven.
Alternatives to AI Bot Access Checker

Scrapling MCP Server
MCP serverMCP server for AI clients to scrape sites with HTTP and stealth browser sessions
Runs locally- 17 tools
- Open source
- 104K GitHub stars
- Web search and scraping

Firecrawl MCP Server
MCP serverMCP server that lets AI agents search, scrape and interact with web pages
- 3 tools
- Remote
- Freemium
- 7.8K GitHub stars
- Web search and scraping

Google Ads + Meta Ads + SEO/GEO MCP
MCP serverHosted MCP connector for managing Google Ads, Meta Ads, GA4 and Search Console from chat
- 8 tools
- Remote
- Freemium
- 8.1K GitHub stars
- Marketing and SEO

SearXNG Search
MCP serverMCP server for web search and page reading through a SearXNG instance
Runs locally- 3 tools
- Open source
- 1.4K GitHub stars
- Web search and scraping

Calven
MCP serverProduct marketing context from Calven delivered into Claude, ChatGPT and other AI tools
Not checked yet- Remote
- Free trial
- 3 GitHub stars
- Marketing and SEO

NeuralVerge
MCP serverStructured, source-tagged business and people data from 300+ sources for agents
- 200 tools
- Remote
- Free trial
- 1 GitHub star
- Web search and scraping