CrawlCheck
Signed checks on what a website serves AI crawlers, for agents to verify before acting
- Pricing
- Freemium
- Platforms
- Web, API
- Runs
- Remotely
- Version
- 1.2.2
- Listing updated
- 2 days ago
About CrawlCheck
CrawlCheck is a freemium MCP server for security. It runs as a hosted remote server, so there is nothing to install locally.
CrawlCheck measures sites by sending requests under named crawler profiles, including separate desktop and smartphone Googlebot, search crawlers, training crawlers and user-triggered fetchers, then compares them with controls from its own network. It also reads robots.txt, machine files and declared agent permissions. Findings come from published rules and the result is signed so it can be verified offline.
For agents, the free answer is a signed Resolve response per domain with a decision for read, cite, connect and transact, plus a signed Preflight receipt per action. The vendor says paying never changes a reading.
Site owners get a free A to F grade, a $100 one-time fix service and Watch monitoring from $29 a month. API plans start at $99 a month for volume scans, and daily census data covers the top 1,000 sites.
Install
Run in a terminal
claude mcp add --transport http crawlcheck https://crawlcheck.io/mcpAdd to Settings → Connectors → Add custom connector
https://crawlcheck.io/mcpAdd to ~/.cursor/mcp.json
{
"mcpServers": {
"crawlcheck": {
"url": "https://crawlcheck.io/mcp"
}
}
}Add to .vscode/mcp.json
{
"servers": {
"crawlcheck": {
"type": "http",
"url": "https://crawlcheck.io/mcp"
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"crawlcheck": {
"serverUrl": "https://crawlcheck.io/mcp"
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"crawlcheck": {
"type": "http",
"url": "https://crawlcheck.io/mcp"
}
}
}What it does
- Signed answers
- Results are signed so an agent can verify them offline.
- Crawler profiles
- Responses are compared across named crawler request profiles.
- Per-action decisions
- Resolve gives read, cite, connect and transact decisions.
- Free site audit
- A to F grade with each problem named.
- Monitoring
- Watch re-checks twice a day and alerts on regressions.
Good for
- Check whether a site is safe to read or cite before acting
- Audit what ChatGPT or Googlebot gets from your site
- Monitor a site for regressions in machine readability
- Pull crawler-access data for research
Pricing
Freemium, from $29 a month
Free checks; fix service $100 once; Watch from $29/month; API from $99/month
Prices change. Check crawlcheck.io before you buy.
CrawlCheck FAQ
Is agent access free?
Yes. Agents ask free and a key only buys fresh scans and volume.
What does fixing cost?
$100 once for one site, according to the pricing page.
What does Watch cost?
From $29 a month, with a 30-day free trial on one domain.
Does paying change the grade?
The site says paying never changes a reading.
Is CrawlCheck free?
CrawlCheck has a free plan, with paid plans for more usage or features. Paid plans start at $29 a month.
How do I add CrawlCheck to Claude Code?
Run this command in your terminal: claude mcp add --transport http crawlcheck https://crawlcheck.io/mcp
What are the best alternatives to CrawlCheck?
The closest alternatives to CrawlCheck are REA, Google Ads + Meta Ads + SEO/GEO MCP, Agent Roast, Midplane and Calven.
Alternatives to CrawlCheck

REA
MCP serverCLI and MCP server that lets coding agents reverse engineer apps and binaries
Runs locally- Open source
- 464K GitHub stars
- Developer tools

Google Ads + Meta Ads + SEO/GEO MCP
MCP serverHosted MCP connector for managing Google Ads, Meta Ads, GA4 and Search Console from chat
- 8 tools
- Remote
- Freemium
- 8.1K GitHub stars
- Marketing and SEO
Agent Roast
MCP serverOffline review that flags agent changes which weaken tests, assertions or CI
Runs locally- Open source
- 4 Hacker News points
- Developer tools

Midplane
MCP serverPostgres gateway for AI agents with table grants, column masking and approval for writes
Runs locally- Open source
- 5 GitHub stars
- Databases

Calven
MCP serverProduct marketing context from Calven delivered into Claude, ChatGPT and other AI tools
Not checked yet- Remote
- Free trial
- 3 GitHub stars
- Marketing and SEO

Leash
MCP serverReview what your AI touched, approve risky actions and undo supported changes
- 1 tool
- Remote
- Free
- 1 GitHub star
- Security