# AI Bot Access Checker

> AI Bot Access Checker is a free MCP server for marketing and seo. Test whether GPTBot, ClaudeBot, PerplexityBot and 10 more crawlers can reach a page. It runs as a hosted remote server, so there is nothing to install locally.

- **Kind:** MCP server
- **Pricing:** Free
- **Platforms:** API, Web
- **Website:** https://seopaslaugos.io/en/tools/ai-bot-access-checker
- **Repository:** https://github.com/seopaslaugos-io/ai-bot-access-checker
- **MCP Registry name:** io.seopaslaugos/ai-bot-access-checker
- **Categories:** marketing and SEO, web search and scraping
- **Listing updated:** 2026-11-14

## About

The check goes beyond reading robots.txt. For each of 13 bots it finds the applicable rule following RFC 9309, then requests the page with that bot's own User-Agent and compares the response with a normal browser's. That second step catches blocks applied by a firewall or CDN even when robots.txt allows the bot, and results distinguish being blocked by robots from being blocked by the server.

The page groups crawlers into search crawlers that build the index AI answers cite, user-triggered fetchers that open a page live, and training crawlers, and notes that blocking one kind does not block the others. It shows, per AI engine, whether the page can be found, opened live and used for training.

The server exposes one tool, check_ai_bot_access, over streamable HTTP. It is free, needs no key and uses an MIT licence. The author states that access is only the first step and does not decide whether AI answers cite a page.

## Features

- **13 bot checks:** Covers OpenAI, Anthropic, Perplexity, Google and Bing crawlers.
- **robots.txt per RFC 9309:** Finds the rule that applies to each bot.
- **Real User-Agent requests:** Detects firewall and CDN blocks.
- **Per-engine view:** Shows find, open live and training access.
- **Free and keyless:** No sign-up, MIT licence.

## Good for

- Confirm your site is open to AI search crawlers
- Debug a firewall that blocks ClaudeBot
- Audit robots.txt before changing training opt-outs
- Add a crawler check to an SEO audit

## Install

### Claude Code (Terminal)

```sh
claude mcp add --transport http ai-bot-access-checker https://tools.seopaslaugos.io/mcp
```

### Claude Desktop (Settings → Connectors → Add custom connector)

```sh
https://tools.seopaslaugos.io/mcp
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "ai-bot-access-checker": {
      "url": "https://tools.seopaslaugos.io/mcp"
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "ai-bot-access-checker": {
      "type": "http",
      "url": "https://tools.seopaslaugos.io/mcp"
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "ai-bot-access-checker": {
      "serverUrl": "https://tools.seopaslaugos.io/mcp"
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "ai-bot-access-checker": {
      "type": "http",
      "url": "https://tools.seopaslaugos.io/mcp"
    }
  }
}
```

## Tools

- `check_ai_bot_access`: Checks whether AI crawlers and search bots (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-User, PerplexityBot, Perplexity-User, Googlebot, Google-Extended, bingbot, Applebot-Extended, CCBot) can reach a page. For each bot it reports the robots.txt rule that applies and whether the server or firewall blocks that User-Agent (403, 429, dropped connection, challenge or captc

## FAQ

### Does it need an API key?

No. It is free with no key.

### Can a page be allowed in robots.txt and still blocked?

Yes. That is why it also requests the page as each bot.

### Does access guarantee AI citations?

No. The page says access is the first requirement, not the last.

### Is AI Bot Access Checker free?

Yes. AI Bot Access Checker is free to use.

### How do I add AI Bot Access Checker to Claude Code?

Run this command in your terminal: claude mcp add --transport http ai-bot-access-checker https://tools.seopaslaugos.io/mcp

### What are the best alternatives to AI Bot Access Checker?

The closest alternatives to AI Bot Access Checker are Scrapling MCP Server, Firecrawl MCP Server, Google Ads + Meta Ads + SEO/GEO MCP, SearXNG Search and Calven.

## Alternatives

- [Scrapling MCP Server](https://ai-powered.com/mcp/scrapling-mcp-server): Scrapling MCP Server is an open-source MCP server for web search and scraping.
- [Firecrawl MCP Server](https://ai-powered.com/mcp/firecrawl-mcp-server): Firecrawl MCP Server is a freemium MCP server for web search and scraping.
- [Google Ads + Meta Ads + SEO/GEO MCP](https://ai-powered.com/mcp/google-ads-meta-ads-seo-geo-mcp): Google Ads + Meta Ads + SEO/GEO MCP is a freemium MCP server for marketing and seo.
- [SearXNG Search](https://ai-powered.com/mcp/searxng-search): SearXNG Search is an open-source MCP server for web search and scraping.
- [Calven](https://ai-powered.com/mcp/calven): Calven is an MCP server for marketing and seo.
- [NeuralVerge](https://ai-powered.com/mcp/neuralverge): NeuralVerge is an MCP server for web search and scraping.
- [AI-Powered directory](https://ai-powered.com/mcp/ai-powered-directory): AI-Powered directory is a free MCP server for developer tools.
- [MCP](https://ai-powered.com/mcp/mcp-mwhffe53): MCP is a freemium MCP server for marketing and seo.

---
Source: https://ai-powered.com/mcp/ai-bot-access-checker
