Skip to content

AI for web search and scraping

9 AI tools, agents, MCP servers and skills for web search and scraping, with pricing, platforms and alternatives for each.

Showing 1–9 of 9

  1. ClawGrab

    MCP server

    Fetch transcripts of public YouTube, TikTok, Vimeo and podcast links for AI use

    Runs locally
    • 6 tools
    • Freemium
    • Web search and scraping
  2. proxy-scraper

    MCP server

    Hourly-checked free HTTP and SOCKS proxy lists with a CLI and MCP tools to fetch pages

    Runs locally
    • Free
    • Web search and scraping
  3. OmniSeek

    MCP server

    Search podcasts, videos, Chinese forums and paper citations from your coding agent

    Not checked yet
    • Remote
    • Free
    • Web search and scraping
  4. Serper.live

    MCP server

    Live Google results and domain rank checks by country and device, pay per search

    Runs locally
    • 3 tools
    • Freemium
    • Web search and scraping
  5. webclaw

    MCP server

    Scrape, crawl, search and extract web pages as clean Markdown or JSON for agents

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  6. Crawl Readiness

    MCP server

    Check which AI crawlers can read a site and generate llms.txt, robots.txt and schema

    Runs locally
    • 9 tools
    • Freemium
    • Web search and scraping
  7. Comment Scraper

    MCP server

    Ask Claude about Reddit and Hacker News threads you exported with Comment Scraper

    Runs locally
    • 4 tools
    • Freemium
    • Web search and scraping
  8. Local research workspace that tracks sources, claims and gaps for your AI agent

    Runs locally
    • 5 tools
    • Free
    • Web search and scraping
  9. FrankenSurf

    MCP server

    Reads web pages with the cheapest tool that works, then checks the page is real

    Runs locally
    • Free
    • Web search and scraping