
Web search, scraping and page interaction API for AI agents and developers
- Freemium
- Agent framework
- 202K GitHub stars
- Web search and scraping

Web search, scraping and page interaction API for AI agents and developers

Web crawler and hosted API that turns URLs into LLM-ready Markdown or JSON

MCP server that lets AI agents search, scrape and interact with web pages
European flight, hotel, power-price, marketplace and company data tools for agents
Runs locallySearch and safety-check x402 APIs, MCP servers and A2A agents by intent

Pay-per-call tools for chain data, sanctions screening, web reading and PDFs
Turn any website, GitHub repo, PDF or video link into llms.txt or llms-full.txt
Ask an agent what a website is: AI builder traces, tech stack, traffic rank and trust
Look up domain status, registry records, registrar prices and the day's auctions
Typed website functions for agents, as an alternative to driving a browser
Give an assistant a cloud browser to scrape, search, crawl and audit pages
31 web scraping, search and research tools that return clean Markdown or JSON
Runs locallyReal-time Amazon product, offer, search and seller data for AI agents, 22 marketplaces
Live data from Reddit, X, TikTok, app stores, ad libraries and 30+ more platforms
Competitor Google ads, app reviews and job listings as pay-per-result Apify tools
Runs locallyRemote MCP server for live Google results, SEO research and web scraping with credits

Pay-per-call social data from Douyin, Xiaohongshu, TikTok, X, YouTube and more
Fetch web pages as clean Markdown for agents, honouring robots.txt and noai
Runs locallyHourly-checked free HTTP and SOCKS proxy lists with a CLI and MCP tools to fetch pages
Runs locallyOfficial SerpApi server: Google, Bing and other search results as JSON or Markdown
Reddit search, comments, users and monitors as 61 pay-per-call MCP tools
Not checked yetOpen-source web scraper for agents with scrape, crawl, map and search tools
Runs locallyLocal MCP server for SnapRender screenshots, with a free trial key
Runs locallyWeb search, URL extract and page render for agents, paid per call over x402 on Base
Runs locallySearch arXiv and OpenAlex papers with citations and PDF links, plus clean URL extraction
Not checked yetGoogle Maps style local business leads, domain OSINT and B2B company dossiers
Not checked yetTurns websites into typed JSON tool calls that agents can search, read, log in and act on
Not checked yetWeb scraping, mapping and crawling MCP server that returns clean Markdown
Not checked yetCompany enrichment, FMCSA carriers, app reviews, live ATS jobs and LatAm tenders via Apify
Not checked yetRole-classified company contacts, security.txt and DNS email posture for a domain
Runs locally