
Web search, scraping and page interaction API for AI agents and developers
- Freemium
- Agent framework
- 202K GitHub stars
- Web search and scraping

Web search, scraping and page interaction API for AI agents and developers

Web crawler and hosted API that turns URLs into LLM-ready Markdown or JSON

MCP server that lets AI agents search, scrape and interact with web pages

Open-source research agent that writes cited reports from the web and your documents

Browser engine and CLI built for agents that browse, extract and crawl at scale

Web API for agents: scrape, search, cloud browsers and task agents, billed in credits

Self-hosted browser agent that scrapes protected sites from a plain-English prompt
Watch web pages from Claude or ChatGPT and read summaries of what changed
Not checked yetFetch transcripts of public YouTube, TikTok, Vimeo and podcast links for AI use
Runs locally
Pay-per-call tools for chain data, sanctions screening, web reading and PDFs
Hosted MCP server for capturing screenshots and page text through ApiFlash
Turn YouTube captions, PDFs and web pages into clean Markdown for RAG
Read Bluesky, Telegram, note.com and WeChat posts without logging in
Check which e-commerce stores publish a UCP profile and what it declares
Shopify store products, app reviews, price drops and cheapest-price lookups for agents
Remote jobs, ATS boards, Hacker News hiring and UK/Sweden visa data for agents
Google Trends, Reddit, GitHub trending, EU tenders and more market signals for agents
Turn audio, images, PDFs, video and web pages into text an agent can read
YouTube transcripts, comments, video stats and channel monitoring for AI agents
Search HiringCafe jobs by title, place and pay, with employer apply links
Paid web, OpenAPI and Base chain evidence for agents, billed per call in USDC
Web search and paged page reading for assistants, with results they can cite
Not checked yetLook up domain status, registry records, registrar prices and the day's auctions
Pay-per-call URL-to-Markdown, B2B enrichment and bounty feeds for agents via x402
Typed website functions for agents, as an alternative to driving a browser
Pay-per-call web and data utilities for agents: page to Markdown, RSS, CSV and JSON
Search every Ashby job board at once, newest first, with optional salary and details
Search every Cornerstone OnDemand career site at once, newest jobs first
Search every Greenhouse job board at once, with salary ranges and posting dates
Search Welcome to the Jungle and Otta jobs by title, place, contract and pay