Skip to content
MCP server

Crawlwise

Audit sites for SEO issues and check whether AI crawlers can read a page

Install
Pricing
Freemium
Platforms
CLI, Web, API
Runs
Remotely
Version
1.1.1
Listing updated
3 days ago

About Crawlwise

Crawlwise is a freemium MCP server for marketing and seo. It runs as a hosted remote server, so there is nothing to install locally.

Crawlwise runs the same audits through its MCP server as on the website, with each finding tied to the check it came from. Its stated rule is that a test it did not measure is never reported as a defect, and no scores are invented. The server is at crawlwise.site/mcp, with OAuth preferred and an API key as fallback, and the site names Claude Code, Cursor, Windsurf and Codex as clients.

A free CLI offers a first look without an account: npx crawlwise ai-crawlers example.com checks whether AI crawlers can read a page, and npx crawlwise audit gives a score and top issues for one page a day. A skill installs the audit, fix and re-audit loop, and a GitHub Action can gate pull requests. The CLI, skill, plugin and action are MIT licensed while the audit engine runs on the hosted site.

Plans are credit based: a full audit costs 1.25 credits. Starter is $14.99 a month for 3 sites, Growth $49.99 adds backlinks, keyword research, rank tracking and API plus MCP at 10,000 calls a day, and Agency $99.99 adds white-label PDF reports. The plugin README notes MCP access needs a Pro plan or above, while the site lists API and MCP under Growth and Agency.

Install

Run in a terminal

claude mcp add --transport http crawlwise https://crawlwise.site/mcp

Add to Settings → Connectors → Add custom connector

https://crawlwise.site/mcp
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "crawlwise": {
      "url": "https://crawlwise.site/mcp"
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "crawlwise": {
      "type": "http",
      "url": "https://crawlwise.site/mcp"
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "crawlwise": {
      "serverUrl": "https://crawlwise.site/mcp"
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "crawlwise": {
      "type": "http",
      "url": "https://crawlwise.site/mcp"
    }
  }
}

What it does

AI crawler check
Tests whether AI crawlers can read a page, free and without a key.
Evidence-linked findings
Cites the check behind every finding and says when something was not measured.
Audit-and-fix skill
Teaches agents to audit, fix priority items and re-audit.
CI gate
Provides a GitHub Action to gate pull requests on audits.
Monitoring and rank tracking
Higher plans add monitored URLs, rank tracking and Search Console and GA4.
Credit pricing
Shows a cost estimate before each run, with a full audit at 1.25 credits.

Good for

  • Check whether ChatGPT-style crawlers can fetch a page
  • Have a coding agent audit and fix SEO issues in a project
  • Block pull requests that introduce SEO regressions
  • Monitor a few URLs for changes

Pricing

Freemium, from $14.99 a month

Free CLI audit (1 page/day); Starter $14.99/mo, Growth $49.99/mo, Agency $99.99/mo; extra credits $0.50 each

Prices change. Check crawlwise.site before you buy.

Crawlwise FAQ

Can I try it without an account?

Yes. The CLI audits one page a day and checks AI crawler access with no account.

What does a full audit cost?

1.25 credits, with the estimate shown before you run it.

Which plans include MCP access?

The site lists API and MCP under Growth and Agency, while the plugin README says Pro and above.

Is it open source?

The CLI, skill, plugin and GitHub Action are MIT licensed; the audit engine is hosted.

Does it invent scores?

The project says it reports honest findings only and no invented scores.

Is Crawlwise free?

Crawlwise has a free plan, with paid plans for more usage or features. Paid plans start at $14.99 a month.

How do I add Crawlwise to Claude Code?

Run this command in your terminal: claude mcp add --transport http crawlwise https://crawlwise.site/mcp

What are the best alternatives to Crawlwise?

The closest alternatives to Crawlwise are REA, Codebase Memory, GitHub, Serena MCP: the IDE for your agent and XERJ.

Alternatives to Crawlwise

  1. REA

    MCP server

    CLI and MCP server that lets coding agents reverse engineer apps and binaries

    Runs locally
    • Open source
    • 464K GitHub stars
    • Developer tools
  2. Codebase Memory

    MCP server

    Local MCP server that builds a code knowledge graph for AI coding agents

    Runs locally
    • Open source
    • 48.7K GitHub stars
    • Knowledge and memory
  3. GitHub

    MCP server

    Official MCP server connecting AI assistants to GitHub repos, issues and workflows

    Not checked yet
    • Remote
    • Open source
    • 34.5K GitHub stars
    • Developer tools
  4. MCP toolkit giving coding agents symbol-level code retrieval and editing

    Runs locally
    • Open source
    • 31.5K GitHub stars
    • Developer tools
  5. XERJ

    MCP server

    Local search engine for AI agents with cited answers over your code and docs

    Runs locally
    • Open source
    • 19.2K GitHub stars
    • Knowledge and memory
  6. Ouroboros

    MCP server

    Spec-first layer that pins requirements and verifies results of AI coding agent work

    Runs locally
    • Open source
    • 6.4K GitHub stars
    • Developer tools