Ai Crawler Policy
Cloudflare Workers MCP server: ai-crawler-policy
- Runs
- Remotely
- Version
- 1.0.0
- Listing updated
- 6 days ago
Similar MCP servers
About Ai Crawler Policy
Ai Crawler Policy is an MCP server for web search and scraping. It runs as a hosted remote server, so there is nothing to install locally.
Install
Run in a terminal
claude mcp add --transport http ai-crawler-policy https://api.lazy-mac.com/ai-crawler-policy/mcpAdd to Settings → Connectors → Add custom connector
https://api.lazy-mac.com/ai-crawler-policy/mcpAdd to ~/.cursor/mcp.json
{
"mcpServers": {
"ai-crawler-policy": {
"url": "https://api.lazy-mac.com/ai-crawler-policy/mcp"
}
}
}Add to .vscode/mcp.json
{
"servers": {
"ai-crawler-policy": {
"type": "http",
"url": "https://api.lazy-mac.com/ai-crawler-policy/mcp"
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"ai-crawler-policy": {
"serverUrl": "https://api.lazy-mac.com/ai-crawler-policy/mcp"
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"ai-crawler-policy": {
"type": "http",
"url": "https://api.lazy-mac.com/ai-crawler-policy/mcp"
}
}
}Using several servers? Build one config file with the MCP config generator.
Ai Crawler Policy FAQ
How do I add Ai Crawler Policy to Claude Code?
Run this command in your terminal: claude mcp add --transport http ai-crawler-policy https://api.lazy-mac.com/ai-crawler-policy/mcp
What are the best alternatives to Ai Crawler Policy?
The closest alternatives to Ai Crawler Policy are ActableSite AI Crawler Monitor, Firecrawl Alternative Stealth MCP, AI Crawler Checker — Robots.txt Policy for Six Bots and NM Signals: AI crawler audit.
Where this comes from
- Description: from the official MCP Registry entry.
- Install steps: from the official MCP Registry entry.