Codebase Memory vs Crawlerpeek
Codebase Memory is an open-source MCP server for knowledge and memory. Crawlerpeek is an open-source MCP server for marketing and seo.
- Codebase Memory is best for find callers of a function.
- Crawlerpeek is best for confirm gptbot is not blocked on a key page.
- What it is
- Codebase Memory is an open-source MCP server for knowledge and memory.Crawlerpeek is an open-source MCP server for marketing and seo.
- Best for
- Find callers of a functionConfirm GPTBot is not blocked on a key page
- Kind
- MCP serverMCP server
- Pricing
- Open sourceOpen source
- Platforms
- CLI, macOS, Linux, Windows, self-hostedWeb, CLI
- Runs
- LocallyLocally
- GitHub stars
- 48.7K
- Last commit
- Nov 2026
- License
- MIT
- Open source
- Good for
- Find callers of a function; Assess the impact of a diff; Link documentation to codeConfirm GPTBot is not blocked on a key page; Fail a deploy when a bot loses access; Check whether a request in server logs is a genuine Googlebot
What Codebase Memory does
Code knowledge graph
Persistent graph of symbols, calls and dependencies.
Multiple search modes
Structural, full-text and local semantic search.
Documentation links
Indexes Markdown, reStructuredText, AsciiDoc and ADRs.
Infrastructure tracing
Connects Docker, Kubernetes, Terraform and CI to source.
Change impact
Maps a diff to affected symbols and related tests.
Native CLI
Query the same graph from the command line.
What Crawlerpeek does
Per-bot robots.txt check
Applies RFC 9309 rules to each crawler and URL path.
Live fetch as the bot
Fetches the page with the bot's user agent and flags block pages.
robots.txt lint
Finds mistakes in a robots.txt from a URL, file or stdin.
Sitemap scan
Checks every sitemap URL against robots.txt for each bot.
Crawler IP verification
Checks an IP against published ranges or reverse DNS.
CI-friendly CLI
Exits non-zero and writes Markdown summaries for GitHub Actions.
Codebase Memory vs Crawlerpeek: questions
Is Codebase Memory or Crawlerpeek cheaper?
Both are open source. Compare current plans on each official site.
What is the difference between Codebase Memory and Crawlerpeek?
Codebase Memory is an open-source MCP server for knowledge and memory. Crawlerpeek is an open-source MCP server for marketing and seo.
