Skip to content

AI tools, agents, MCP servers and skills for web search and scraping

1,212 MCP servers, 15 agent skills, 6 AI tools and 2 AI agents for web search and scraping, including Scrapling MCP Server, Competitor profiling and firecrawl. Each listing shows pricing, platforms and alternatives; use the kind links to see only one kind.

Showing 1,201–1,230 of 1,235

  1. Extract clean markdown from any URL. Removes boilerplate. For RAG pipelines. x402.

    Not checked yet
    • Remote
    • Files and documents
  2. Scrape Amazon products, search, and async batch ASIN lookups across 20 marketplaces

    Runs locally
    • Open source
    • Web search and scraping
  3. Reddit Scraper

    MCP server

    Reddit MCP server: search posts, subreddit feeds, comments & user profiles as JSON. No…

    Not checked yet
    • Remote
    • Web search and scraping
  4. Agentfetch

    MCP server

    Token-budgeted web fetch for AI agents — auto-routes Jina, FireCrawl, Trafilatura, PDF.

    Runs locally
    • Open source
    • Web search and scraping
  5. Firecrawl

    MCP server

    Scrape, crawl, and extract structured data from websites at scale

    Runs locally
    • Open source
    • Web search and scraping
  6. Google Search

    MCP server

    Scrape Google search results with SERP data, ads, and knowledge panels

    Runs locally
    • Open source
    • Web search and scraping
  7. Query search analytics, manage sitemaps, and inspect site URLs and status

    Runs locally
    • Open source
    • Web search and scraping
  8. Syftly

    MCP server

    Ranks the best AI tool or API per task: transcription, TTS, web search, scraping and OCR.

    Not checked yet
    • Remote
    • Web search and scraping
  9. Web scraping for AI agents. Extract text and metadata from any URL worldwide. $0.005/page.

    Not checked yet
    • Remote
    • Web search and scraping
  10. Scrape messages, extract leads from public Telegram channels. No login required.

    Runs locally
    • Open source
    • Web search and scraping
  11. Cloudflare Workers MCP server: ai-crawler-policy

    Not checked yet
    • Remote
    • Web search and scraping
  12. Token compression for web content — 70-80% reduction from HTML to clean markdown

    Runs locally
    • Open source
    • Web search and scraping
  13. 40+ competitive intel tools. Brand.dev, Coresignal, Keywords Everywhere, Exa, Firecrawl.

    Not checked yet
    • Remote
    • Web search and scraping
  14. 40+ content research tools. Perplexity, Tavily, Semantic Scholar, FLUX, Ideogram, Recraft.

    Not checked yet
    • Remote
    • Web search and scraping
  15. 35+ web scraping tools. Firecrawl, Bright Data, Jina, Olostep, ScrapeGraph, Notte…

    Not checked yet
    • Remote
    • Web search and scraping
  16. Bing Ads

    MCP server

    MCP server for Microsoft Advertising (Bing Ads) — campaigns, keywords, and reports

    Runs locally
    • Open source
    • Web search and scraping
  17. Secure MCP server for Google Search Console analytics, sitemaps, and URL inspection

    Runs locally
    • Open source
    • Web search and scraping
  18. Fully local MCP server and CLI for web research

    Runs locally
    • Open source
    • Web search and scraping
  19. Perplexity MCP server backed by the Polza.ai chat completions API.

    Runs locally
    • Open source
    • Web search and scraping
  20. ShadowCrawl

    MCP server

    Stealth scraping & search. Bypasses Cloudflare, DataDome & LinkedIn via Cyborg HITL…

    Not checked yet
    • Remote
    • Web search and scraping
  21. smart-web

    MCP server

    Web search, direct-URL fetch, crawl, and docs export MCP. smartfetch for URLs.

    Runs locally
    • Open source
    • Web search and scraping
  22. Quran Search Engine MCP for AI tools. Provides Quran search, Arabic normalization, and…

    Runs locally
    • Open source
    • Web search and scraping
  23. Search the web, images, videos, news, and local businesses with robust filters…

    Not checked yet
    • Remote
    • Web search and scraping
  24. Bridge Claude Code with Perplexity Comet for autonomous browsing and tab management

    Runs locally
    • Open source
    • Web search and scraping
  25. Find open-source libraries and fetch contextual code snippets by version to accelerate…

    Not checked yet
    • Remote
    • Web search and scraping
  26. Scraper

    MCP server

    Web scraping MCP — extract clean markdown, links, and metadata from any URL.

    Runs locally
    • Open source
    • Web search and scraping
  27. Web Scraper

    MCP server

    MCP server for web scraping: URLs, links, metadata, CSS extraction.

    Runs locally
    • Open source
    • Web search and scraping
  28. Enrich IPs, emails, domains, companies. Scrape SEC, news, jobs, Crunchbase. Bitcoin…

    Not checked yet
    • Remote
    • Web search and scraping
  29. Free Bing search MCP server - No API key required

    Runs locally
    • Open source
    • Web search and scraping
  30. Web Fetch MCP

    MCP server

    MCP server for web content fetching, summarizing, comparing, and extracting information

    Runs locally
    • Open source
    • Web search and scraping