Skip to content

AI for web search and scraping

340 AI tools, agents and MCP servers for web search and scraping, with pricing, platforms and alternatives for each.

Showing 1–30 of 340

  1. Web search, scraping and page interaction API for AI agents and developers

    • Freemium
    • Agent framework
    • 202K GitHub stars
    • Web search and scraping
  2. Web crawler and hosted API that turns URLs into LLM-ready Markdown or JSON

    • Freemium
    • Open-source agent
    • 87.5K GitHub stars
    • Web search and scraping
  3. MCP server that lets AI agents search, scrape and interact with web pages

    • 3 tools
    • Remote
    • Freemium
    • 7.8K GitHub stars
    • Web search and scraping
  4. Web API for agents: scrape, search, cloud browsers and task agents, billed in credits

    • Freemium
    • Open-source agent
    • 745 GitHub stars
    • Web search and scraping
  5. ChangePing

    MCP server

    Watch web pages from Claude or ChatGPT and read summaries of what changed

    Not checked yet
    • 7 tools
    • Remote
    • Freemium
    • Web search and scraping
  6. ClawGrab

    MCP server

    Fetch transcripts of public YouTube, TikTok, Vimeo and podcast links for AI use

    Runs locally
    • 6 tools
    • Freemium
    • Web search and scraping
  7. Pay-per-call tools for chain data, sanctions screening, web reading and PDFs

    • 15 tools
    • Remote
    • Freemium
    • Web search and scraping
  8. Hosted MCP server for capturing screenshots and page text through ApiFlash

    • 3 tools
    • Remote
    • Freemium
    • Browser automation
  9. Turn YouTube captions, PDFs and web pages into clean Markdown for RAG

    • Remote
    • Freemium
    • Knowledge and memory
  10. Read Bluesky, Telegram, note.com and WeChat posts without logging in

    • Remote
    • Freemium
    • Web search and scraping
  11. Check which e-commerce stores publish a UCP profile and what it declares

    • Remote
    • Freemium
    • E-commerce
  12. Shopify store products, app reviews, price drops and cheapest-price lookups for agents

    • 6 tools
    • Remote
    • Freemium
    • E-commerce
  13. Jobs Data MCP

    MCP server

    Remote jobs, ATS boards, Hacker News hiring and UK/Sweden visa data for agents

    • 5 tools
    • Remote
    • Freemium
    • Hiring and recruiting
  14. Google Trends, Reddit, GitHub trending, EU tenders and more market signals for agents

    • 14 tools
    • Remote
    • Freemium
    • Analytics and data
  15. Turn audio, images, PDFs, video and web pages into text an agent can read

    • 6 tools
    • Remote
    • Freemium
    • Files and documents
  16. YouTube transcripts, comments, video stats and channel monitoring for AI agents

    • 6 tools
    • Remote
    • Freemium
    • Design and media
  17. Paid web, OpenAPI and Base chain evidence for agents, billed per call in USDC

    • 12 tools
    • Remote
    • Freemium
    • Web search and scraping
  18. Web search and paged page reading for assistants, with results they can cite

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  19. Pay-per-call URL-to-Markdown, B2B enrichment and bounty feeds for agents via x402

    • 8 tools
    • Remote
    • Freemium
    • Web search and scraping
  20. Unique.domains

    MCP server

    Look up domain status, registry records, registrar prices and the day's auctions

    • 51 tools
    • Remote
    • Freemium
    • Analytics and data
  21. Orchard

    MCP server

    Pay-per-call web and data utilities for agents: page to Markdown, RSS, CSV and JSON

    • 16 tools
    • Remote
    • Freemium
    • Files and documents