Skip to content

Codebase Memory vs Crawlerpeek

Codebase Memory is an open-source MCP server for knowledge and memory. Crawlerpeek is an open-source MCP server for marketing and seo.

  • Codebase Memory is best for find callers of a function.
  • Crawlerpeek is best for confirm gptbot is not blocked on a key page.
What it is
Codebase Memory is an open-source MCP server for knowledge and memory.
Crawlerpeek is an open-source MCP server for marketing and seo.
Best for
Find callers of a function
Confirm GPTBot is not blocked on a key page
Kind
MCP server
MCP server
Pricing
Open source
Open source
Platforms
CLI, macOS, Linux, Windows, self-hosted
Web, CLI
Runs
Locally
Locally
GitHub stars
48.7K
Last commit
Nov 2026
License
MIT
Open source
Good for
Find callers of a function; Assess the impact of a diff; Link documentation to code
Confirm GPTBot is not blocked on a key page; Fail a deploy when a bot loses access; Check whether a request in server logs is a genuine Googlebot

What Codebase Memory does

  • Code knowledge graph

    Persistent graph of symbols, calls and dependencies.

  • Multiple search modes

    Structural, full-text and local semantic search.

  • Documentation links

    Indexes Markdown, reStructuredText, AsciiDoc and ADRs.

  • Infrastructure tracing

    Connects Docker, Kubernetes, Terraform and CI to source.

  • Change impact

    Maps a diff to affected symbols and related tests.

  • Native CLI

    Query the same graph from the command line.

What Crawlerpeek does

  • Per-bot robots.txt check

    Applies RFC 9309 rules to each crawler and URL path.

  • Live fetch as the bot

    Fetches the page with the bot's user agent and flags block pages.

  • robots.txt lint

    Finds mistakes in a robots.txt from a URL, file or stdin.

  • Sitemap scan

    Checks every sitemap URL against robots.txt for each bot.

  • Crawler IP verification

    Checks an IP against published ranges or reverse DNS.

  • CI-friendly CLI

    Exits non-zero and writes Markdown summaries for GitHub Actions.

Codebase Memory vs Crawlerpeek: questions

Is Codebase Memory or Crawlerpeek cheaper?

Both are open source. Compare current plans on each official site.

What is the difference between Codebase Memory and Crawlerpeek?

Codebase Memory is an open-source MCP server for knowledge and memory. Crawlerpeek is an open-source MCP server for marketing and seo.