
Web search, scraping and page interaction API for AI agents and developers
- Freemium
- Agent framework
- 202K GitHub stars
- Web search and scraping

Web search, scraping and page interaction API for AI agents and developers

Web crawler and hosted API that turns URLs into LLM-ready Markdown or JSON

MCP server that lets AI agents search, scrape and interact with web pages

Open-source research agent that writes cited reports from the web and your documents

Browser engine and CLI built for agents that browse, extract and crawl at scale

Web API for agents: scrape, search, cloud browsers and task agents, billed in credits

Self-hosted browser agent that scrapes protected sites from a plain-English prompt
Watch web pages from Claude or ChatGPT and read summaries of what changed
Not checked yetSearch and safety-check x402 APIs, MCP servers and A2A agents by intent
Fetch transcripts of public YouTube, TikTok, Vimeo and podcast links for AI use
Runs locally
Pay-per-call tools for chain data, sanctions screening, web reading and PDFs
Turn any website, GitHub repo, PDF or video link into llms.txt or llms-full.txt
Search a catalogue of Apify Actors and n8n recipes for web-data jobs
Look up the official API and ranked scraping tools for 172 websites
Read public X Articles, video transcripts and posts as plain text, no account needed
Hosted MCP server for capturing screenshots and page text through ApiFlash
Ask an agent what a website is: AI builder traces, tech stack, traffic rank and trust
Turn YouTube captions, PDFs and web pages into clean Markdown for RAG
Read Bluesky, Telegram, note.com and WeChat posts without logging in
Check which e-commerce stores publish a UCP profile and what it declares
Shopify store products, app reviews, price drops and cheapest-price lookups for agents
Remote jobs, ATS boards, Hacker News hiring and UK/Sweden visa data for agents
Google Trends, Reddit, GitHub trending, EU tenders and more market signals for agents
Turn audio, images, PDFs, video and web pages into text an agent can read
YouTube transcripts, comments, video stats and channel monitoring for AI agents
Search a free directory of MCP servers and x402 services, or list your own
Search HiringCafe jobs by title, place and pay, with employer apply links
Paid web, OpenAPI and Base chain evidence for agents, billed per call in USDC
Web search and paged page reading for assistants, with results they can cite
Not checked yetPay-per-call URL-to-Markdown, B2B enrichment and bounty feeds for agents via x402