Skip to content

AI for web search and scraping

450 AI tools, agents, MCP servers and skills for web search and scraping, with pricing, platforms and alternatives for each.

Showing 1–30 of 450

  1. Web search, scraping and page interaction API for AI agents and developers

    • Freemium
    • Agent framework
    • 202K GitHub stars
    • Web search and scraping
  2. Web crawler and hosted API that turns URLs into LLM-ready Markdown or JSON

    • Freemium
    • Open-source agent
    • 87.5K GitHub stars
    • Web search and scraping
  3. MCP server that lets AI agents search, scrape and interact with web pages

    • 3 tools
    • Remote
    • Freemium
    • 7.8K GitHub stars
    • Web search and scraping
  4. Web API for agents: scrape, search, cloud browsers and task agents, billed in credits

    • Freemium
    • Open-source agent
    • 745 GitHub stars
    • Web search and scraping
  5. NeuralVerge

    MCP server

    Structured, source-tagged business and people data from 300+ sources for agents

    • 200 tools
    • Remote
    • Free trial
    • 1 GitHub star
    • Web search and scraping
  6. Search AI tools, agents and MCP servers and get install configs from inside your AI assistant.

    • 4 tools
    • Remote
    • Free
    • Developer tools
  7. easyserp

    MCP server

    Structured Google and Bing search results for agents, with recoverable requests

    Runs locally
    • Free trial
    • Web search and scraping
  8. ChangePing

    MCP server

    Watch web pages from Claude or ChatGPT and read summaries of what changed

    Not checked yet
    • 7 tools
    • Remote
    • Freemium
    • Web search and scraping
  9. ClawGrab

    MCP server

    Fetch transcripts of public YouTube, TikTok, Vimeo and podcast links for AI use

    Runs locally
    • 6 tools
    • Freemium
    • Web search and scraping
  10. Pay-per-call tools for chain data, sanctions screening, web reading and PDFs

    • 15 tools
    • Remote
    • Freemium
    • Web search and scraping
  11. llms.ink

    MCP server

    Turn any website, GitHub repo, PDF or video link into llms.txt or llms-full.txt

    • 7 tools
    • Remote
    • Free
    • AI models and LLM tooling
  12. Search a catalogue of Apify Actors and n8n recipes for web-data jobs

    • 8 tools
    • Remote
    • Free
    • Web search and scraping
  13. Scraper Finder

    MCP server

    Look up the official API and ranked scraping tools for 172 websites

    • 3 tools
    • Remote
    • Free
    • Web search and scraping
  14. x-toolkit

    MCP server

    Read public X Articles, video transcripts and posts as plain text, no account needed

    • 4 tools
    • Remote
    • Free
    • Web search and scraping
  15. Hosted MCP server for capturing screenshots and page text through ApiFlash

    • 3 tools
    • Remote
    • Freemium
    • Browser automation
  16. Fetch pages and search the web through a Singapore 4G/5G mobile IP from your agent

    • 4 tools
    • Remote
    • Free trial
    • Web search and scraping
  17. maviapi

    MCP server

    Live JSON from sites with no API, plus agent-built APIs for any website

    Runs locally
    • 9 tools
    • Free trial
    • Web search and scraping
  18. CheckAnySite

    MCP server

    Ask an agent what a website is: AI builder traces, tech stack, traffic rank and trust

    • 6 tools
    • Remote
    • Free
    • Analytics and data
  19. Turn YouTube captions, PDFs and web pages into clean Markdown for RAG

    • Remote
    • Freemium
    • Knowledge and memory
  20. Read Bluesky, Telegram, note.com and WeChat posts without logging in

    • Remote
    • Freemium
    • Web search and scraping
  21. Check which e-commerce stores publish a UCP profile and what it declares

    • Remote
    • Freemium
    • E-commerce
  22. Shopify store products, app reviews, price drops and cheapest-price lookups for agents

    • 6 tools
    • Remote
    • Freemium
    • E-commerce
  23. Jobs Data MCP

    MCP server

    Remote jobs, ATS boards, Hacker News hiring and UK/Sweden visa data for agents

    • 5 tools
    • Remote
    • Freemium
    • Hiring and recruiting
  24. Google Trends, Reddit, GitHub trending, EU tenders and more market signals for agents

    • 14 tools
    • Remote
    • Freemium
    • Analytics and data
  25. Turn audio, images, PDFs, video and web pages into text an agent can read

    • 6 tools
    • Remote
    • Freemium
    • Files and documents
  26. YouTube transcripts, comments, video stats and channel monitoring for AI agents

    • 6 tools
    • Remote
    • Freemium
    • Design and media
  27. Search a free directory of MCP servers and x402 services, or list your own

    • 12 tools
    • Remote
    • Free
    • Web search and scraping
  28. Paid web, OpenAPI and Base chain evidence for agents, billed per call in USDC

    • 12 tools
    • Remote
    • Freemium
    • Web search and scraping