# Botcard

> Botcard is a free MCP server for marketing and seo. Cited registry of AI crawler robots.txt tokens and a robots.txt checker. It runs as a hosted remote server, so there is nothing to install locally.

- **Kind:** MCP server
- **Pricing:** Free
- **Platforms:** API, Web
- **Website:** https://whosthatbot.com
- **MCP Registry name:** com.whosthatbot/botcard
- **Categories:** marketing and SEO, developer tools
- **Listing updated:** 2026-11-16

## About

Botcard tells training, search, person-triggered fetching and open crawling apart for AI crawlers. Its registry holds 125 cards from 24 vendors, each citing the vendor's own page and noting when it was checked, with a field such as whether a disallow is an opt-out, whether robots.txt may not apply, or whether the token is only a control.

Four read-only tools are exposed. A checker takes pasted robots.txt text and a path and returns allow or disallow for each token under RFC 9309, along with the vendor's stance. Other tools list crawlers, fetch one card, and suggest a robots.txt from a policy such as allow search and block training. The service never fetches the host you ask about, and the response reports fetched_target false.

The cards flag details that matter, for example that Google-Extended has no user agent of its own and does not change Search inclusion, that OAI-SearchBot is independent of GPTBot, and that Perplexity-User and Meta-ExternalFetcher may ignore robots.txt. No key is needed.

## Features

- **Cited crawler registry:** 125 cards across 24 vendors with source citations and check dates.
- **robots.txt checker:** Answers allow or disallow per token for a path under RFC 9309.
- **Policy-based generator:** Suggests a robots.txt from rules such as allow search, block training.
- **Purpose classification:** Separates training, search, user fetch and open crawls.
- **Control tokens handled:** Notes tokens like Google-Extended that do not crawl.
- **No fetching:** Works only on pasted text and never visits a site.

## Good for

- Block AI training crawlers but allow search
- Check whether a robots.txt blocks GPTBot
- Look up what a specific crawler token does
- Generate a robots.txt that follows a stated policy

## Install

### Claude Code (Terminal)

```sh
claude mcp add --transport http botcard https://whosthatbot.com/mcp
```

### Claude Desktop (Settings → Connectors → Add custom connector)

```sh
https://whosthatbot.com/mcp
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "botcard": {
      "url": "https://whosthatbot.com/mcp"
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "botcard": {
      "type": "http",
      "url": "https://whosthatbot.com/mcp"
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "botcard": {
      "serverUrl": "https://whosthatbot.com/mcp"
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "botcard": {
      "type": "http",
      "url": "https://whosthatbot.com/mcp"
    }
  }
}
```

## Tools

- `check_robots`: Checks pasted robots.txt against crawler tokens for a path.
- `list_crawlers`: Lists crawlers in the registry.
- `get_crawler`: Returns one crawler's card.
- `suggest_robots`: Suggests a robots.txt from a stated policy.

## FAQ

### Does it visit my site?

No, it only reads the robots.txt text you provide.

### How many crawlers are covered?

125 cards from 24 vendors.

### Is a key needed?

No.

### Does blocking Google-Extended remove me from Search?

The Botcard entry says it does not change Search inclusion or ranking.

### Is Botcard free?

Yes. Botcard is free to use.

### How do I add Botcard to Claude Code?

Run this command in your terminal: claude mcp add --transport http botcard https://whosthatbot.com/mcp

### What are the best alternatives to Botcard?

The closest alternatives to Botcard are REA, Codebase Memory, GitHub, Serena MCP: the IDE for your agent and XERJ.

## Alternatives

- [REA](https://ai-powered.com/mcp/rea): REA is an open-source MCP server for developer tools.
- [Codebase Memory](https://ai-powered.com/mcp/codebase-memory): Codebase Memory is an open-source MCP server for knowledge and memory.
- [GitHub](https://ai-powered.com/mcp/github-2): GitHub is an open-source MCP server for developer tools.
- [Serena MCP: the IDE for your agent](https://ai-powered.com/mcp/serena-mcp-the-ide-for-your-agent): Serena MCP: the IDE for your agent is an open-source MCP server for developer tools.
- [XERJ](https://ai-powered.com/mcp/xerj): XERJ is an open-source MCP server for knowledge and memory.
- [Ouroboros](https://ai-powered.com/mcp/ouroboros): Ouroboros is an open-source MCP server for developer tools.
- [Claude Code Ultimate Guide](https://ai-powered.com/mcp/claude-code-ultimate-guide): Claude Code Ultimate Guide is an open-source MCP server for ai models and llm tooling.
- [Google Ads + Meta Ads + SEO/GEO MCP](https://ai-powered.com/mcp/google-ads-meta-ads-seo-geo-mcp): Google Ads + Meta Ads + SEO/GEO MCP is a freemium MCP server for marketing and seo.

---
Source: https://ai-powered.com/mcp/botcard
