# Code Crawler

> Code Crawler is an open-source MCP server for web search and scraping. Trace what really runs in Java, Python, TypeScript and JavaScript, with edge confidence. It runs locally on your machine and is started by your AI client.

- **Kind:** MCP server
- **Pricing:** Open source
- **Platforms:** CLI, self-hosted
- **Website:** https://nithin554.github.io/code-crawler/
- **Repository:** https://github.com/nithin554/code-crawler
- **MCP Registry name:** io.github.nithin554/code-crawler
- **Categories:** web search and scraping, developer tools
- **Listing updated:** 2026-11-14

## About

Plain grep finds strings, but questions like who transitively calls a method or what breaks if an interface changes are graph traversals. Code-Crawler indexes a project once into a single SQLite file and answers them with recursive SQL, with no external service. The site mentions 29 MCP tools.

Its graph includes the things static call graphs miss: interface and base-class calls fan out to every override, injected dependencies, AspectJ and Spring AOP advice, reflective lookups, and routes or listeners invoked by a framework. Every edge carries a confidence so an assistant can tell fact from guess.

Re-crawls use a per-file manifest of size, modified time and SHA-256, and the site cites 0.9 s versus 22 s on a 137k-line project. Parsing uses tree-sitter WASM grammars.

## Features

- **Call tracing:** Finds transitive callers, callees and shortest paths with call-site lines.
- **Virtual dispatch:** Expands interface calls to every override.
- **Runtime wiring:** Models routes, dependency injection, reflection and AOP advice.
- **Hotspots and dead code:** Ranks by fan-in, fan-out and advice count.
- **Incremental crawls:** Re-parses only changed files.

## Good for

- Find everything that calls a method
- Judge the blast radius of an interface change
- List endpoints and what they call
- Spot dead-code candidates

## Install

### Claude Code (Terminal)

```sh
claude mcp add code-crawler -- npx -y @nithin554/code-crawler
```

### Claude Desktop (claude_desktop_config.json)

```json
{
  "mcpServers": {
    "code-crawler": {
      "command": "npx",
      "args": [
        "-y",
        "@nithin554/code-crawler"
      ]
    }
  }
}
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "code-crawler": {
      "command": "npx",
      "args": [
        "-y",
        "@nithin554/code-crawler"
      ]
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "code-crawler": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "@nithin554/code-crawler"
      ]
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "code-crawler": {
      "command": "npx",
      "args": [
        "-y",
        "@nithin554/code-crawler"
      ]
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "code-crawler": {
      "command": "npx",
      "args": [
        "-y",
        "@nithin554/code-crawler"
      ]
    }
  }
}
```

## Tools

- `crawl_project`: Indexes a project into the graph.
- `search_symbols`: Searches symbols.
- `get_callers`: Finds callers of a symbol.
- `get_callees`: Finds callees of a symbol.
- `trace_path`: Finds a path between two symbols.
- `trace_execution`: Traces execution from a symbol.
- `find_implementations`: Finds implementations of an interface or base class.
- `find_routes`: Lists routes and endpoints.
- `find_injections`: Lists injected dependencies.
- `find_aspects`: Lists aspect advice.
- `find_hotspots`: Ranks heavily connected symbols.
- `find_dead_code`: Finds dead-code candidates.
- `get_decorators`: Queries decorators and annotations.

## FAQ

### Which languages are supported?

Java, Python, TypeScript and JavaScript.

### Where is the index stored?

In a single SQLite file, index.db, by default under ~/.code-crawler.

### Does it need a server?

No server, docker or external database.

### Can I skip folders?

Yes, with the CODECRAWLER_EXCLUDE_DIRS setting.

### Is Code Crawler free?

Yes. Code Crawler is open source, so you can use and self-host it for free.

### How do I add Code Crawler to Claude Code?

Run this command in your terminal: claude mcp add code-crawler -- npx -y @nithin554/code-crawler

### What are the best alternatives to Code Crawler?

The closest alternatives to Code Crawler are REA, Scrapling MCP Server, Codebase Memory, GitHub and Serena MCP: the IDE for your agent.

## Alternatives

- [REA](https://ai-powered.com/mcp/rea): REA is an open-source MCP server for developer tools.
- [Scrapling MCP Server](https://ai-powered.com/mcp/scrapling-mcp-server): Scrapling MCP Server is an open-source MCP server for web search and scraping.
- [Codebase Memory](https://ai-powered.com/mcp/codebase-memory): Codebase Memory is an open-source MCP server for knowledge and memory.
- [GitHub](https://ai-powered.com/mcp/github-2): GitHub is an open-source MCP server for developer tools.
- [Serena MCP: the IDE for your agent](https://ai-powered.com/mcp/serena-mcp-the-ide-for-your-agent): Serena MCP: the IDE for your agent is an open-source MCP server for developer tools.
- [XERJ](https://ai-powered.com/mcp/xerj): XERJ is an open-source MCP server for knowledge and memory.
- [Firecrawl MCP Server](https://ai-powered.com/mcp/firecrawl-mcp-server): Firecrawl MCP Server is a freemium MCP server for web search and scraping.
- [Ouroboros](https://ai-powered.com/mcp/ouroboros): Ouroboros is an open-source MCP server for developer tools.

---
Source: https://ai-powered.com/mcp/code-crawler
