# Robots Inspect

> Robots Inspect is an MCP server. Fetch a public robots.txt and return group counts only. It runs as a hosted remote server, so there is nothing to install locally.

- **Kind:** MCP server
- **Repository:** https://github.com/sadri-dridi/robots-inspect-mcp
- **MCP Registry name:** io.github.sadri-dridi/robots-inspect
- **Listing updated:** 2026-11-13

## About

Fetch a public robots.txt and return group counts only.

## Install

### Claude Code (Terminal)

```sh
claude mcp add --transport http robots-inspect https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-inspect/mcp
```

### Claude Desktop (Settings → Connectors → Add custom connector)

```sh
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-inspect/mcp
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "robots-inspect": {
      "url": "https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-inspect/mcp"
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "robots-inspect": {
      "type": "http",
      "url": "https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-inspect/mcp"
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "robots-inspect": {
      "serverUrl": "https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-inspect/mcp"
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "robots-inspect": {
      "type": "http",
      "url": "https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-inspect/mcp"
    }
  }
}
```

## FAQ

### How do I add Robots Inspect to Claude Code?

Run this command in your terminal: claude mcp add --transport http robots-inspect https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-inspect/mcp

## Where this comes from

- Description: from the official MCP Registry entry.
- Install steps: from the official MCP Registry entry.

---
Source: https://ai-powered.com/mcp/robots-inspect
