Skip to content

AI for web search and scraping

237 AI tools, agents, MCP servers and skills for web search and scraping, with pricing, platforms and alternatives for each.

Showing 31–60 of 237

  1. Distill MCP

    MCP server

    Fetch web pages as clean Markdown for agents, honouring robots.txt and noai

    Runs locally
    • 2 tools
    • Freemium
    • Web search and scraping
  2. proxy-scraper

    MCP server

    Hourly-checked free HTTP and SOCKS proxy lists with a CLI and MCP tools to fetch pages

    Runs locally
    • Free
    • Web search and scraping
  3. SerpApi

    MCP server

    Official SerpApi server: Google, Bing and other search results as JSON or Markdown

    • 4 tools
    • Remote
    • Freemium
    • Web search and scraping
  4. RedditAPIs

    MCP server

    Reddit search, comments, users and monitors as 61 pay-per-call MCP tools

    Not checked yet
    • 1 tool
    • Remote
    • Paid
    • Web search and scraping
  5. Fetch web pages as markdown with SSRF protection, reader mode, feeds and robots checks

    Runs locally
    • 15 tools
    • Open source
    • Web search and scraping
  6. CRW Web Scraper

    MCP server

    Open-source web scraper for agents with scrape, crawl, map and search tools

    Runs locally
    • 3 tools
    • Freemium
    • Web search and scraping
  7. SnapRender

    MCP server

    Local MCP server for SnapRender screenshots, with a free trial key

    Runs locally
    • 3 tools
    • Freemium
    • Browser automation
  8. Web search, URL extract and page render for agents, paid per call over x402 on Base

    Runs locally
    • 8 tools
    • Freemium
    • Web search and scraping
  9. Search arXiv and OpenAlex papers with citations and PDF links, plus clean URL extraction

    Not checked yet
    • 24 tools
    • Remote
    • Freemium
    • Health and science
  10. Google Maps style local business leads, domain OSINT and B2B company dossiers

    Not checked yet
    • 24 tools
    • Remote
    • Freemium
    • Maps and travel
  11. Wield

    MCP server

    Turns websites into typed JSON tool calls that agents can search, read, log in and act on

    Not checked yet
    • 5 tools
    • Remote
    • Freemium
    • Browser automation
  12. Octocrawl

    MCP server

    Web scraping, mapping and crawling MCP server that returns clean Markdown

    Not checked yet
    • 2 tools
    • Remote
    • Freemium
    • Web search and scraping
  13. Company enrichment, FMCSA carriers, app reviews, live ATS jobs and LatAm tenders via Apify

    Not checked yet
    • 5 tools
    • Remote
    • Freemium
    • Analytics and data
  14. Remote MCP endpoint for Olostep's search, scrape and crawl API

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  15. Self-hosted Google Search Console MCP for analytics, URL inspection and sitemaps

    Not checked yet
    • Remote
    • Open source
    • Marketing and SEO
  16. Pull Google Maps, reviews, web pages and public LinkedIn data into your assistant

    Runs locally
    • 4 tools
    • Free trial
    • Maps and travel
  17. OmniSeek

    MCP server

    Search podcasts, videos, Chinese forums and paper citations from your coding agent

    Not checked yet
    • Remote
    • Free
    • Web search and scraping
  18. Socialscrape

    MCP server

    Social media profiles, posts, comments, search and transcripts across 29 platforms

    Not checked yet
    • 11 tools
    • Remote
    • Freemium
    • Web search and scraping
  19. Code Crawler

    MCP server

    Trace what really runs in Java, Python, TypeScript and JavaScript, with edge confidence

    Runs locally
    • 13 tools
    • Open source
    • Web search and scraping
  20. apinoa

    MCP server

    One key for Amazon, TikTok, Google and AI-answer data, as MCP tools or sandboxed code

    Not checked yet
    • 10 tools
    • Remote
    • Paid
    • Web search and scraping
  21. API.SH

    MCP server

    Search, call and bill public web data endpoints from chat via API.SH

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  22. Copyseeker

    MCP server

    Reverse image search, AI-image and NSFW detection tools for your assistant

    Runs locally
    • 3 tools
    • Paid
    • Web search and scraping
  23. Diffbot

    MCP server

    Search the web, extract pages and query a knowledge graph through Diffbot's index

    Not checked yet
    • 6 tools
    • Remote
    • Freemium
    • Web search and scraping
  24. Keryx

    MCP server

    Cited research answers with source budgets and visible USDC payment states

    Not checked yet
    • 3 tools
    • Remote
    • Free trial
    • Web search and scraping
  25. UpRock

    MCP server

    Fetch pages, search the web and search video from real devices in chosen countries

    Not checked yet
    • 1 tool
    • Remote
    • Paid
    • Web search and scraping
  26. Clawifi

    MCP server

    Web search, page and PDF reading, and passage extraction with sources for agents

    Not checked yet
    • 6 tools
    • Remote
    • Freemium
    • Web search and scraping