# robots.txt group count

> robots.txt group count is an MCP server for web search and scraping. Remote MCP endpoint reporting a robots.txt group count, for autonomous agent clients. It runs as a hosted remote server, so there is nothing to install locally.

- **Kind:** MCP server
- **Platforms:** API
- **Repository:** https://github.com/sadri-dridi/named-mcp-utilities
- **MCP Registry name:** io.github.sadri-dridi/robots-count
- **Categories:** [web search and scraping](https://ai-powered.com/categories/web-search-and-scraping)
- **Listing updated:** 2026-11-18

## About

This is one entry in a collection of small, single-purpose public MCP servers published under the sadri-dridi namespace. The registry entry names it only as a robots.txt group count and gives no further detail on its inputs or output.

It is reached as a remote streamable-http endpoint hosted on a Cloudflare Workers domain, so nothing needs to be installed locally. No package is published for it. The repository README describes the collection as independently listed public servers for autonomous clients, each folder mapping to one official registry name.

The same repository also lists sibling servers for identifier and calendar checks, and a set of doors that route agents to an advertising service. Tool names and parameters for this particular server are not documented.

## Features

- **Remote streamable-http endpoint:** Connects to a hosted MCP URL over streamable HTTP, with no local install.
- **Single-purpose utility:** Focused on one narrow function, a robots.txt group count.
- **Registry-listed name:** Published in the official MCP registry as io.github.sadri-dridi/robots-count.

## Good for

- Testing an MCP client against a minimal remote server
- Letting an agent query a robots.txt group count
- Exploring small single-function MCP utilities for autonomous clients

## Install

### Claude Code (Terminal)

```sh
claude mcp add --transport http robots-count https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-count/mcp
```

### Claude Desktop (Settings → Connectors → Add custom connector)

```sh
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-count/mcp
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "robots-count": {
      "url": "https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-count/mcp"
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "robots-count": {
      "type": "http",
      "url": "https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-count/mcp"
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "robots-count": {
      "serverUrl": "https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-count/mcp"
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "robots-count": {
      "type": "http",
      "url": "https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-count/mcp"
    }
  }
}
```

## FAQ

### How do I connect to it?

Point an MCP client that supports streamable HTTP at https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-count/mcp.

### Does it need to be installed?

No package is published; it runs as a hosted remote endpoint.

### What is its registry name?

io.github.sadri-dridi/robots-count.

### How do I add robots.txt group count to Claude Code?

Run this command in your terminal: claude mcp add --transport http robots-count https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-count/mcp

### What are the best alternatives to robots.txt group count?

The closest alternatives to robots.txt group count are robots.txt Allow count, body discarded and Sitemap URL count, body discarded.

## Where this comes from

- Description: written from the project's README and its MCP Registry entry.
- Install steps: from the official MCP Registry entry.

## Alternatives

- [robots.txt Allow count, body discarded](https://ai-powered.com/mcp/robots-txt-allow-count-body-discarded): robots.txt Allow count, body discarded is an MCP server for marketing and seo.
- [Sitemap URL count, body discarded](https://ai-powered.com/mcp/sitemap-url-count-body-discarded): Sitemap URL count, body discarded is an MCP server for web search and scraping.

---
Source: https://ai-powered.com/mcp/robots-txt-group-count
