Skip to content

AI tools, agents, MCP servers and skills for web search and scraping

1,212 MCP servers, 15 agent skills, 6 AI tools and 2 AI agents for web search and scraping, including Scrapling MCP Server, Competitor profiling and firecrawl. Each listing shows pricing, platforms and alternatives; use the kind links to see only one kind.

Showing 1–30 of 405

  1. Web search, scraping and page interaction API for AI agents and developers

    • Freemium
    • Agent framework
    • 203K GitHub stars
    • Web search and scraping
  2. Web crawler and hosted API that turns URLs into LLM-ready Markdown or JSON

    • Freemium
    • Open-source agent
    • 87.5K GitHub stars
    • Web search and scraping
  3. MCP server that lets AI agents search, scrape and interact with web pages

    • 3 tools
    • Remote
    • Freemium
    • 7.9K GitHub stars
    • Web search and scraping
  4. Web API for agents: scrape, search, cloud browsers and task agents, billed in credits

    • Freemium
    • Open-source agent
    • 746 GitHub stars
    • Web search and scraping
  5. NeuralVerge

    MCP server

    Structured, source-tagged business and people data from 300+ sources for agents

    • 200 tools
    • Remote
    • Free trial
    • 1 GitHub star
    • Web search and scraping
  6. easyserp

    MCP server

    Structured Google and Bing search results for agents, with recoverable requests

    Runs locally
    • Free trial
    • Web search and scraping
  7. ChangePing

    MCP server

    Watch web pages from Claude or ChatGPT and read summaries of what changed

    Not checked yet
    • 7 tools
    • Remote
    • Freemium
    • Web search and scraping
  8. ClawGrab

    MCP server

    Fetch transcripts of public YouTube, TikTok, Vimeo and podcast links for AI use

    Runs locally
    • 6 tools
    • Freemium
    • Web search and scraping
  9. Pay-per-call tools for chain data, sanctions screening, web reading and PDFs

    • 15 tools
    • Remote
    • Freemium
    • Web search and scraping
  10. Hosted MCP server for capturing screenshots and page text through ApiFlash

    • 3 tools
    • Remote
    • Freemium
    • Browser automation
  11. Fetch pages and search the web through a Singapore 4G/5G mobile IP from your agent

    • 4 tools
    • Remote
    • Free trial
    • Web search and scraping
  12. maviapi

    MCP server

    Live JSON from sites with no API, plus agent-built APIs for any website

    Runs locally
    • 9 tools
    • Free trial
    • Web search and scraping
  13. Turn YouTube captions, PDFs and web pages into clean Markdown for RAG

    • Remote
    • Freemium
    • Knowledge and memory
  14. Read Bluesky, Telegram, note.com and WeChat posts without logging in

    • Remote
    • Freemium
    • Web search and scraping
  15. Check which e-commerce stores publish a UCP profile and what it declares

    • Remote
    • Freemium
    • E-commerce
  16. Shopify store products, app reviews, price drops and cheapest-price lookups for agents

    • 6 tools
    • Remote
    • Freemium
    • E-commerce
  17. Jobs Data MCP

    MCP server

    Remote jobs, ATS boards, Hacker News hiring and UK/Sweden visa data for agents

    • 5 tools
    • Remote
    • Freemium
    • Hiring and recruiting
  18. Google Trends, Reddit, GitHub trending, EU tenders and more market signals for agents

    • 14 tools
    • Remote
    • Freemium
    • Analytics and data
  19. Turn audio, images, PDFs, video and web pages into text an agent can read

    • 6 tools
    • Remote
    • Freemium
    • Files and documents
  20. YouTube transcripts, comments, video stats and channel monitoring for AI agents

    • 6 tools
    • Remote
    • Freemium
    • Design and media
  21. Paid web, OpenAPI and Base chain evidence for agents, billed per call in USDC

    • 12 tools
    • Remote
    • Freemium
    • Web search and scraping
  22. Web search and paged page reading for assistants, with results they can cite

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  23. Unique.domains

    MCP server

    Look up domain status, registry records, registrar prices and the day's auctions

    • 51 tools
    • Remote
    • Freemium
    • Analytics and data
  24. Pay-per-call URL-to-Markdown, B2B enrichment and bounty feeds for agents via x402

    • 8 tools
    • Remote
    • Freemium
    • Web search and scraping