Skip to content
MCP server

CrawlCheck

Signed checks on what a website serves AI crawlers, for agents to verify before acting

Install
Pricing
Freemium
Platforms
Web, API
Runs
Remotely
Version
1.2.2
Listing updated
2 days ago

About CrawlCheck

CrawlCheck is a freemium MCP server for security. It runs as a hosted remote server, so there is nothing to install locally.

CrawlCheck measures sites by sending requests under named crawler profiles, including separate desktop and smartphone Googlebot, search crawlers, training crawlers and user-triggered fetchers, then compares them with controls from its own network. It also reads robots.txt, machine files and declared agent permissions. Findings come from published rules and the result is signed so it can be verified offline.

For agents, the free answer is a signed Resolve response per domain with a decision for read, cite, connect and transact, plus a signed Preflight receipt per action. The vendor says paying never changes a reading.

Site owners get a free A to F grade, a $100 one-time fix service and Watch monitoring from $29 a month. API plans start at $99 a month for volume scans, and daily census data covers the top 1,000 sites.

Install

Run in a terminal

claude mcp add --transport http crawlcheck https://crawlcheck.io/mcp

Add to Settings → Connectors → Add custom connector

https://crawlcheck.io/mcp
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "crawlcheck": {
      "url": "https://crawlcheck.io/mcp"
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "crawlcheck": {
      "type": "http",
      "url": "https://crawlcheck.io/mcp"
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "crawlcheck": {
      "serverUrl": "https://crawlcheck.io/mcp"
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "crawlcheck": {
      "type": "http",
      "url": "https://crawlcheck.io/mcp"
    }
  }
}

What it does

Signed answers
Results are signed so an agent can verify them offline.
Crawler profiles
Responses are compared across named crawler request profiles.
Per-action decisions
Resolve gives read, cite, connect and transact decisions.
Free site audit
A to F grade with each problem named.
Monitoring
Watch re-checks twice a day and alerts on regressions.

Good for

  • Check whether a site is safe to read or cite before acting
  • Audit what ChatGPT or Googlebot gets from your site
  • Monitor a site for regressions in machine readability
  • Pull crawler-access data for research

Pricing

Freemium, from $29 a month

Free checks; fix service $100 once; Watch from $29/month; API from $99/month

Prices change. Check crawlcheck.io before you buy.

CrawlCheck FAQ

Is agent access free?

Yes. Agents ask free and a key only buys fresh scans and volume.

What does fixing cost?

$100 once for one site, according to the pricing page.

What does Watch cost?

From $29 a month, with a 30-day free trial on one domain.

Does paying change the grade?

The site says paying never changes a reading.

Is CrawlCheck free?

CrawlCheck has a free plan, with paid plans for more usage or features. Paid plans start at $29 a month.

How do I add CrawlCheck to Claude Code?

Run this command in your terminal: claude mcp add --transport http crawlcheck https://crawlcheck.io/mcp

What are the best alternatives to CrawlCheck?

The closest alternatives to CrawlCheck are REA, Google Ads + Meta Ads + SEO/GEO MCP, Agent Roast, Midplane and Calven.

Alternatives to CrawlCheck

  1. REA

    MCP server

    CLI and MCP server that lets coding agents reverse engineer apps and binaries

    Runs locally
    • Open source
    • 464K GitHub stars
    • Developer tools
  2. Hosted MCP connector for managing Google Ads, Meta Ads, GA4 and Search Console from chat

    • 8 tools
    • Remote
    • Freemium
    • 8.1K GitHub stars
    • Marketing and SEO
  3. Agent Roast

    MCP server

    Offline review that flags agent changes which weaken tests, assertions or CI

    Runs locally
    • Open source
    • 4 Hacker News points
    • Developer tools
  4. Midplane

    MCP server

    Postgres gateway for AI agents with table grants, column masking and approval for writes

    Runs locally
    • Open source
    • 5 GitHub stars
    • Databases
  5. Calven

    MCP server

    Product marketing context from Calven delivered into Claude, ChatGPT and other AI tools

    Not checked yet
    • Remote
    • Free trial
    • 3 GitHub stars
    • Marketing and SEO
  6. Leash

    MCP server

    Review what your AI touched, approve risky actions and undo supported changes

    • 1 tool
    • Remote
    • Free
    • 1 GitHub star
    • Security