# Crawlsight

> Crawlsight is an open-source MCP server. Check a site's AI visibility: crawler access, llms.txt generate and validate, robots.txt lint. It runs locally on your machine and is started by your AI client.

- **Kind:** MCP server
- **Pricing:** Open source
- **Repository:** https://github.com/cloudcorprecords/crawlsight
- **MCP Registry name:** io.github.CloudCorpRecords/crawlsight
- **Listing updated:** 2026-11-18

## About

Check a site's AI visibility: crawler access, llms.txt generate and validate, robots.txt lint.

## Install

### Claude Code (Terminal)

```sh
claude mcp add crawlsight -- npx -y @reneturcios/crawlsight
```

### Claude Desktop (claude_desktop_config.json)

```json
{
  "mcpServers": {
    "crawlsight": {
      "command": "npx",
      "args": [
        "-y",
        "@reneturcios/crawlsight"
      ]
    }
  }
}
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "crawlsight": {
      "command": "npx",
      "args": [
        "-y",
        "@reneturcios/crawlsight"
      ]
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "crawlsight": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "@reneturcios/crawlsight"
      ]
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "crawlsight": {
      "command": "npx",
      "args": [
        "-y",
        "@reneturcios/crawlsight"
      ]
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "crawlsight": {
      "command": "npx",
      "args": [
        "-y",
        "@reneturcios/crawlsight"
      ]
    }
  }
}
```

## FAQ

### Is Crawlsight free?

Yes. Crawlsight is open source, so you can use and self-host it for free.

### How do I add Crawlsight to Claude Code?

Run this command in your terminal: claude mcp add crawlsight -- npx -y @reneturcios/crawlsight

## Where this comes from

- Description: from the official MCP Registry entry.
- Install steps: from the official MCP Registry entry.

---
Source: https://ai-powered.com/mcp/crawlsight
