
Web search, scraping and page interaction API for AI agents and developers
- Freemium
- Agent framework
- 203K GitHub stars
- Web search and scraping

Web search, scraping and page interaction API for AI agents and developers

Web crawler and hosted API that turns URLs into LLM-ready Markdown or JSON

MCP server that lets AI agents search, scrape and interact with web pages
Read public X Articles, video transcripts and posts as plain text, no account needed
Turn YouTube captions, PDFs and web pages into clean Markdown for RAG
Turn audio, images, PDFs, video and web pages into text an agent can read
Pay-per-call URL-to-Markdown, B2B enrichment and bounty feeds for agents via x402
Pay-per-call web and data utilities for agents: page to Markdown, RSS, CSV and JSON

Read public webpages as Markdown, extract JSON, list links and run bounded crawls
Hosted and open-source web scraper that returns clean Markdown with change tracking
31 web scraping, search and research tools that return clean Markdown or JSON
Runs locallyCrawl and scrape sites to markdown, then ask what changed between runs
Not checked yetFetch web pages as clean Markdown for agents, honouring robots.txt and noai
Runs locallyOfficial SerpApi server: Google, Bing and other search results as JSON or Markdown

Reads web pages for agents as clean markdown with hidden instructions stripped
Not checked yetTurn any web page into clean Markdown, design tokens and a link list for LLMs
Not checked yetOpen-source web scraper for agents with scrape, crawl, map and search tools
Runs locallyWeb scraping, mapping and crawling MCP server that returns clean Markdown
Not checked yet
Remote MCP endpoint for Olostep's search, scrape and crawl API
Not checked yetEmail address checks, URL uptime pings and page-to-markdown reading for agents
Not checked yetPay-per-call web page reader that returns markdown or extracted text over x402
Not checked yetHosted MCP tool that fetches a public web page live and returns Markdown, text or HTML
Not checked yetGives agents live page content from any public URL, with actionable error messages
Not checked yetLive page-to-Markdown fetch for agents, billed per page with rendering surcharges
Not checked yetRemote fetch tool for agents: one URL, a bearer key and a stateless HTTP transport
Not checked yetWeb page retrieval for LLM context, with six paid tiers and a no-card free test
Not checked yetRemote MCP server that fetches live web pages as Markdown, text or HTML for agents
Not checked yetMCPScraper API: hosted MCP tool that turns any public URL into Markdown, text or HTML
Not checked yetScrape any URL to Markdown or JSON, with JavaScript rendering and batch jobs
Not checked yetCrawl a website into clean Markdown, RAG chunks and llms.txt files
Not checked yet