Skip to content

AIPoweredBot

AIPoweredBot is the crawler and checker behind AI-Powered, a directory of AI tools, agents, MCP servers and agent skills. It keeps listings accurate by reading the products' own pages and by checking whether hosted MCP servers answer.

User agent

Every request identifies itself with this user agent:

AIPoweredBot/1.0 (+https://ai-powered.com/bot)

What it fetches from websites

  • Public pages only: a product's home page, its pricing page and its README or registry entry.
  • It reads robots.txt first and follows it, including Crawl-delay.
  • It waits at least two seconds between requests to the same site.
  • It never signs in, fills in forms or works around bot protection. A challenge page means it stops.

How it checks MCP servers

  • Only hosted servers with a public https address from the official MCP Registry. Servers that run on your own machine are never started.
  • It sends the MCP initialize handshake and asks for tools/list. It never calls a tool, and never sends credentials, API keys or tokens.
  • If a server asks for sign-in, we record that it answered and what kind of sign-in it asked for.
  • Requests to one host go one at a time, with a pause between them, and time out after 15 seconds.

How often: every day for the 2,000 most popular hosted servers and for any whose status changed in the last week, and once a week for the rest.

In the last 24 hours it checked 1,185 servers; 99% of them answered.

Where the results go

Results are shown on each server's public status page (for example /mcp/<server>/status), on its listing and in the README badge. The tool list and the tools' own annotations (such as "read-only") are shown as the server reported them; we don't verify them.

How to opt out

  • Website crawling: add a robots.txt rule for User-agent: AIPoweredBot, for example Disallow: /.
  • MCP server checks: email info@ai-powered.com with the host name. Servers on that host are no longer checked, and their pages say "Not checked at the operator's request".

Questions or a problem with our traffic? Email info@ai-powered.com. More on how listings are written and ranked: About and methodology.