
MCP server for AI clients to scrape sites with HTTP and stealth browser sessions
Runs locally- 17 tools
- Open source
- 104K GitHub stars
- Web search and scraping

MCP server for AI clients to scrape sites with HTTP and stealth browser sessions
Runs locally
MCP server for web search and page reading through a SearXNG instance
Runs locallySearch AI tools, agents and MCP servers and get install configs from inside your AI assistant.
Search and safety-check x402 APIs, MCP servers and A2A agents by intent
Turn any website, GitHub repo, PDF or video link into llms.txt or llms-full.txt
Search a catalogue of Apify Actors and n8n recipes for web-data jobs
Look up the official API and ranked scraping tools for 172 websites
Read public X Articles, video transcripts and posts as plain text, no account needed
Ask an agent what a website is: AI builder traces, tech stack, traffic rank and trust
Search a free directory of MCP servers and x402 services, or list your own
Search Console clicks, positions, URL inspection and sitemaps for your AI agent
Runs locallyLocal deep research assistant that checks each citation and keeps what it finds
Runs locallyFree check of whether GPTBot, ClaudeBot and PerplexityBot can really reach a website
Test whether GPTBot, ClaudeBot, PerplexityBot and 10 more crawlers can reach a page
Check whether a half-remembered thing can be found before your agent answers
Hourly-checked free HTTP and SOCKS proxy lists with a CLI and MCP tools to fetch pages
Runs locallyFetch web pages as markdown with SSRF protection, reader mode, feeds and robots checks
Runs locallyTurn any web page into clean Markdown, design tokens and a link list for LLMs
Not checked yetCheck that links load and quotes really appear on a page, from your assistant
Not checked yetSelf-hosted Google Search Console MCP for analytics, URL inspection and sitemaps
Not checked yetSearch podcasts, videos, Chinese forums and paper citations from your coding agent
Not checked yetTrace what really runs in Java, Python, TypeScript and JavaScript, with edge confidence
Runs locallyFind page-extraction services from a frozen catalogue; a time-limited free experiment
Not checked yetFree lookup an agent can query to see if a site permits AI agents to browse, shop or book
Not checked yetSearch immunology and virology literature, trials and grants across six databases at once
Not checked yetEurope PMC literature search, full text and export for AI agents (Python, MIT)
Runs locallyWatch a web page, CSS selector, JSON value or price and get changes by poll or webhook
Not checked yetRead-only Google Play data for agents: apps, charts, reviews, permissions and data safety
Runs locallyCrawl documentation sites into local Markdown that agents search offline
Runs locallySearch expiring and recently dropped domain names by drop date, rank and linking domains
Not checked yetSee every kind of AI for web search and scraping: tools, agents, MCP servers and skills.Ranked: the best AI for web search and scraping.