Skip to content

CitedBy vs Crawl Readiness

CitedBy is a freemium MCP server for marketing and seo. Crawl Readiness is a freemium MCP server for web search and scraping.

  • CitedBy is best for find out if gptbot and perplexitybot can read your site.
  • Crawl Readiness is best for find out whether gptbot or claudebot is blocked on a site.
What it is
CitedBy is a freemium MCP server for marketing and seo.
Crawl Readiness is a freemium MCP server for web search and scraping.
Best for
Find out if GPTBot and PerplexityBot can read your site
Find out whether GPTBot or ClaudeBot is blocked on a site
Kind
MCP server
MCP server
Pricing
Freemium
Freemium, from $39 a month
Platforms
API, Web
API, CLI, macOS, Windows, Linux
Runs
Remotely
Locally
Open source
Good for
Find out if GPTBot and PerplexityBot can read your site; Audit a pricing page before an AI-search push; Validate that llms.txt links resolve
Find out whether GPTBot or ClaudeBot is blocked on a site; Generate llms.txt from a sitemap; Audit a robots.txt for orphan rules and wildcard traps

What CitedBy does

  • Single-page check

    Deterministic on-page checks with the exact fix for each finding.

  • AI crawler access

    Tests eight named bots against robots.txt and server responses.

  • llms.txt check

    Confirms llms.txt exists, its links work and llms-full.txt exists.

  • Backlink domains

    Counts linking domains using the Common Crawl web graph.

  • Honest failures

    Reports pages it could not fetch instead of guessing.

  • MIT licensed client

    The repository is MIT-licensed.

What Crawl Readiness does

  • Crawler readiness score

    Scores a site 0-100 against 60 AI crawlers with a prioritised fix list.

  • Signed permission receipts

    Answers whether a use is allowed and returns an Ed25519-signed receipt.

  • Content parity check

    Compares what Chrome, GPTBot, ClaudeBot and PerplexityBot each receive.

  • JSON-LD validation

    Audits structured data against 20+ common types.

  • File generators

    Writes llms.txt, robots.txt presets and Organization or Article JSON-LD.

  • Answer Analysis trend

    Reads whether AI search named your brand or competitors over time.

CitedBy vs Crawl Readiness: questions

Is CitedBy or Crawl Readiness cheaper?

Both are freemium. Compare current plans on each official site.

What is the difference between CitedBy and Crawl Readiness?

CitedBy is a freemium MCP server for marketing and seo. Crawl Readiness is a freemium MCP server for web search and scraping.

Keep comparing