
MCP server for AI clients to scrape sites with HTTP and stealth browser sessions
Runs locally- 17 tools
- Open source
- 104K GitHub stars
- Web search and scraping

MCP server for AI clients to scrape sites with HTTP and stealth browser sessions
Runs locally
MCP server for web search and page reading through a SearXNG instance
Runs locallySearch and safety-check x402 APIs, MCP servers and A2A agents by intent
Turn any website, GitHub repo, PDF or video link into llms.txt or llms-full.txt
Ask an agent what a website is: AI builder traces, tech stack, traffic rank and trust
Search Console clicks, positions, URL inspection and sitemaps for your AI agent
Runs locallyLocal deep research assistant that checks each citation and keeps what it finds
Runs locallyHourly-checked free HTTP and SOCKS proxy lists with a CLI and MCP tools to fetch pages
Runs locallyFetch web pages as markdown with SSRF protection, reader mode, feeds and robots checks
Runs locallySelf-hosted Google Search Console MCP for analytics, URL inspection and sitemaps
Not checked yetSearch podcasts, videos, Chinese forums and paper citations from your coding agent
Not checked yetTrace what really runs in Java, Python, TypeScript and JavaScript, with edge confidence
Runs locallyEurope PMC literature search, full text and export for AI agents (Python, MIT)
Runs locallyRead-only Google Play data for agents: apps, charts, reviews, permissions and data safety
Runs locallyCrawl documentation sites into local Markdown that agents search offline
Runs locallyBrowse login-protected and JavaScript-heavy pages through your own Chrome, Edge or Brave
Runs locallyTurns web pages and PDFs into cached Markdown outlines read one section at a time
Runs locally
Search 1,500+ indie-made products as alternatives to big-name software from your AI
Not checked yetPassive-by-default OSINT lookups for AI agents: DNS, WHOIS, IP, breaches, Shodan and more
Runs locallyLocal, read-only Google Search Console tools for traffic, indexing and sitemap checks
Runs locallyWeb research for agents that returns cited claims with confidence scores
Runs locallySearch launched products, alternatives and weekly launch boards on MakerRadar
Not checked yetTurn any web page into clean Markdown with one tool, run locally with no API key
Runs locallyDocker-run MCP server for finding public emails and subdomains of a domain
Runs locallyDocker-run MCP server that identifies the CMS, server and frameworks behind a website
Runs locallyCheck domain availability and registrar prices and look up public domain records
Not checked yetKeyless web search, page fetching and document reading that runs locally
Runs locallyWeb-fetch tool that returns block pages as failures, via your own Proxlane gateway
Runs locallyFind songs by a remembered lyric or title and read lyrics from lyrics.com
Runs locallyOpen-source MCP server for web search via SearXNG or You.com and Markdown crawling
Runs locallySee every kind of AI for web search and scraping: tools, agents, MCP servers and skills.Ranked: the best AI for web search and scraping.