Skip to content
MCP server

AI Bot Access Checker

Test whether GPTBot, ClaudeBot, PerplexityBot and 10 more crawlers can reach a page

Status and history

Answered our latest tool-list check 22 hours ago with 1 tools. It will be marked verified after 3 successful checks in 7 days.

Install
Pricing
Free
Platforms
API, Web
Runs
Remotely
Version
1.3.0
Listing updated
3 days ago

About AI Bot Access Checker

AI Bot Access Checker is a free MCP server for marketing and seo. It runs as a hosted remote server, so there is nothing to install locally.

The check goes beyond reading robots.txt. For each of 13 bots it finds the applicable rule following RFC 9309, then requests the page with that bot's own User-Agent and compares the response with a normal browser's. That second step catches blocks applied by a firewall or CDN even when robots.txt allows the bot, and results distinguish being blocked by robots from being blocked by the server.

The page groups crawlers into search crawlers that build the index AI answers cite, user-triggered fetchers that open a page live, and training crawlers, and notes that blocking one kind does not block the others. It shows, per AI engine, whether the page can be found, opened live and used for training.

The server exposes one tool, check_ai_bot_access, over streamable HTTP. It is free, needs no key and uses an MIT licence. The author states that access is only the first step and does not decide whether AI answers cite a page.

Install

Run in a terminal

claude mcp add --transport http ai-bot-access-checker https://tools.seopaslaugos.io/mcp

Add to Settings → Connectors → Add custom connector

https://tools.seopaslaugos.io/mcp
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "ai-bot-access-checker": {
      "url": "https://tools.seopaslaugos.io/mcp"
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "ai-bot-access-checker": {
      "type": "http",
      "url": "https://tools.seopaslaugos.io/mcp"
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "ai-bot-access-checker": {
      "serverUrl": "https://tools.seopaslaugos.io/mcp"
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "ai-bot-access-checker": {
      "type": "http",
      "url": "https://tools.seopaslaugos.io/mcp"
    }
  }
}

Tools this server provides (1)

Read directly from the server.

check_ai_bot_access
Checks whether AI crawlers and search bots (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-User, PerplexityBot, Perplexity-User, Googlebot, Google-Extended, bingbot, Applebot-Extended, CCBot) can reach a page. For each bot it reports the robots.txt rule that applies and whether the server or firewall blocks that User-Agent (403, 429, dropped connection, challenge or captc

What it does

13 bot checks
Covers OpenAI, Anthropic, Perplexity, Google and Bing crawlers.
robots.txt per RFC 9309
Finds the rule that applies to each bot.
Real User-Agent requests
Detects firewall and CDN blocks.
Per-engine view
Shows find, open live and training access.
Free and keyless
No sign-up, MIT licence.

Good for

  • Confirm your site is open to AI search crawlers
  • Debug a firewall that blocks ClaudeBot
  • Audit robots.txt before changing training opt-outs
  • Add a crawler check to an SEO audit

Pricing

Free

Prices change. Check seopaslaugos.io before you buy.

AI Bot Access Checker FAQ

Does it need an API key?

No. It is free with no key.

Can a page be allowed in robots.txt and still blocked?

Yes. That is why it also requests the page as each bot.

Does access guarantee AI citations?

No. The page says access is the first requirement, not the last.

Is AI Bot Access Checker free?

Yes. AI Bot Access Checker is free to use.

How do I add AI Bot Access Checker to Claude Code?

Run this command in your terminal: claude mcp add --transport http ai-bot-access-checker https://tools.seopaslaugos.io/mcp

What are the best alternatives to AI Bot Access Checker?

The closest alternatives to AI Bot Access Checker are Scrapling MCP Server, Firecrawl MCP Server, Google Ads + Meta Ads + SEO/GEO MCP, SearXNG Search and Calven.

Alternatives to AI Bot Access Checker

  1. MCP server for AI clients to scrape sites with HTTP and stealth browser sessions

    Runs locally
    • 17 tools
    • Open source
    • 104K GitHub stars
    • Web search and scraping
  2. MCP server that lets AI agents search, scrape and interact with web pages

    • 3 tools
    • Remote
    • Freemium
    • 7.8K GitHub stars
    • Web search and scraping
  3. Hosted MCP connector for managing Google Ads, Meta Ads, GA4 and Search Console from chat

    • 8 tools
    • Remote
    • Freemium
    • 8.1K GitHub stars
    • Marketing and SEO
  4. SearXNG Search

    MCP server

    MCP server for web search and page reading through a SearXNG instance

    Runs locally
    • 3 tools
    • Open source
    • 1.4K GitHub stars
    • Web search and scraping
  5. Calven

    MCP server

    Product marketing context from Calven delivered into Claude, ChatGPT and other AI tools

    Not checked yet
    • Remote
    • Free trial
    • 3 GitHub stars
    • Marketing and SEO
  6. NeuralVerge

    MCP server

    Structured, source-tagged business and people data from 300+ sources for agents

    • 200 tools
    • Remote
    • Free trial
    • 1 GitHub star
    • Web search and scraping