Skip to content

AI tools, agents, MCP servers and skills for web search and scraping

1,168 MCP servers, 10 agent skills, 6 AI tools and 2 AI agents for web search and scraping, including Scrapling MCP Server, firecrawl and Firecrawl MCP Server. Each listing shows pricing, platforms and alternatives; use the kind links to see only one kind.

Showing 1–30 of 124

  1. Web search, scraping and page interaction API for AI agents and developers

    • Freemium
    • Agent framework
    • 202K GitHub stars
    • Web search and scraping
  2. Web crawler and hosted API that turns URLs into LLM-ready Markdown or JSON

    • Freemium
    • Open-source agent
    • 87.5K GitHub stars
    • Web search and scraping
  3. MCP server that lets AI agents search, scrape and interact with web pages

    • 3 tools
    • Remote
    • Freemium
    • 7.8K GitHub stars
    • Web search and scraping
  4. Pay-per-call tools for chain data, sanctions screening, web reading and PDFs

    • 15 tools
    • Remote
    • Freemium
    • Web search and scraping
  5. llms.ink

    MCP server

    Turn any website, GitHub repo, PDF or video link into llms.txt or llms-full.txt

    • 7 tools
    • Remote
    • Free
    • AI models and LLM tooling
  6. CheckAnySite

    MCP server

    Ask an agent what a website is: AI builder traces, tech stack, traffic rank and trust

    • 6 tools
    • Remote
    • Free
    • Analytics and data
  7. Unique.domains

    MCP server

    Look up domain status, registry records, registrar prices and the day's auctions

    • 51 tools
    • Remote
    • Freemium
    • Analytics and data
  8. Browserless

    MCP server

    Give an assistant a cloud browser to scrape, search, crawl and audit pages

    • 5 tools
    • Remote
    • Freemium
    • Browser automation
  9. 31 web scraping, search and research tools that return clean Markdown or JSON

    Runs locally
    • 28 tools
    • Freemium
    • Web search and scraping
  10. FetchLayer

    MCP server

    Live data from Reddit, X, TikTok, app stores, ad libraries and 30+ more platforms

    • Remote
    • Freemium
    • Web search and scraping
  11. DataFluxor

    MCP server

    Remote MCP server for live Google results, SEO research and web scraping with credits

    • Remote
    • Freemium
    • Marketing and SEO
  12. Distill MCP

    MCP server

    Fetch web pages as clean Markdown for agents, honouring robots.txt and noai

    Runs locally
    • 2 tools
    • Freemium
    • Web search and scraping
  13. proxy-scraper

    MCP server

    Hourly-checked free HTTP and SOCKS proxy lists with a CLI and MCP tools to fetch pages

    Runs locally
    • Free
    • Web search and scraping
  14. SerpApi

    MCP server

    Official SerpApi server: Google, Bing and other search results as JSON or Markdown

    • 4 tools
    • Remote
    • Freemium
    • Web search and scraping
  15. CRW Web Scraper

    MCP server

    Open-source web scraper for agents with scrape, crawl, map and search tools

    Runs locally
    • 3 tools
    • Freemium
    • Web search and scraping
  16. SnapRender

    MCP server

    Local MCP server for SnapRender screenshots, with a free trial key

    Runs locally
    • 3 tools
    • Freemium
    • Browser automation
  17. Web search, URL extract and page render for agents, paid per call over x402 on Base

    Runs locally
    • 8 tools
    • Freemium
    • Web search and scraping
  18. Search arXiv and OpenAlex papers with citations and PDF links, plus clean URL extraction

    Not checked yet
    • 24 tools
    • Remote
    • Freemium
    • Health and science
  19. Google Maps style local business leads, domain OSINT and B2B company dossiers

    Not checked yet
    • 24 tools
    • Remote
    • Freemium
    • Maps and travel
  20. Wield

    MCP server

    Turns websites into typed JSON tool calls that agents can search, read, log in and act on

    Not checked yet
    • 5 tools
    • Remote
    • Freemium
    • Browser automation
  21. Octocrawl

    MCP server

    Web scraping, mapping and crawling MCP server that returns clean Markdown

    Not checked yet
    • 2 tools
    • Remote
    • Freemium
    • Web search and scraping
  22. Company enrichment, FMCSA carriers, app reviews, live ATS jobs and LatAm tenders via Apify

    Not checked yet
    • 5 tools
    • Remote
    • Freemium
    • Analytics and data
  23. Remote MCP endpoint for Olostep's search, scrape and crawl API

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  24. OmniSeek

    MCP server

    Search podcasts, videos, Chinese forums and paper citations from your coding agent

    Not checked yet
    • Remote
    • Free
    • Web search and scraping
  25. Socialscrape

    MCP server

    Social media profiles, posts, comments, search and transcripts across 29 platforms

    Not checked yet
    • 11 tools
    • Remote
    • Freemium
    • Web search and scraping
  26. API.SH

    MCP server

    Search, call and bill public web data endpoints from chat via API.SH

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  27. Diffbot

    MCP server

    Search the web, extract pages and query a knowledge graph through Diffbot's index

    Not checked yet
    • 6 tools
    • Remote
    • Freemium
    • Web search and scraping