Skip to content

AI tools, agents, MCP servers and skills for web search and scraping

1,212 MCP servers, 15 agent skills, 6 AI tools and 2 AI agents for web search and scraping, including Scrapling MCP Server, Competitor profiling and firecrawl. Each listing shows pricing, platforms and alternatives; use the kind links to see only one kind.

Showing 1–22 of 22

  1. Open-source research agent that writes cited reports from the web and your documents

    • Open source
    • Open-source agent
    • 30.8K GitHub stars
    • Research
  2. Browser engine and CLI built for agents that browse, extract and crawl at scale

    • Open source
    • Open-source agent
    • 1.2K GitHub stars
    • Browser automation
  3. Self-hosted browser agent that scrapes protected sites from a plain-English prompt

    • Open source
    • Open-source agent
    • 180 GitHub stars
    • Web search and scraping
  4. Remote MCP server that searches the MCP Harbor directory of MCP servers and agent tools

    Not checked yet
    • 2 tools
    • Remote
    • Open source
    • Developer tools
  5. Query your website change-tracking history and monitors in plain language

    Not checked yet
    • Remote
    • Open source
    • Productivity
  6. LastSearch

    MCP server

    Web research for agents that returns cited claims with confidence scores

    Runs locally
    • Open source
    • Web search and scraping
  7. Turn any web page into clean Markdown with one tool, run locally with no API key

    Runs locally
    • 1 tool
    • Open source
    • Files and documents
  8. Rangefind

    MCP server

    Static-file search engine with an MCP server so AI agents can query prebuilt indexes

    Runs locally
    • 5 tools
    • Open source
    • 3 GitHub stars
    • Web search and scraping
  9. searxNcrawl

    MCP server

    Open-source MCP server for web search via SearXNG or You.com and Markdown crawling

    Runs locally
    • 3 tools
    • Open source
    • Web search and scraping
  10. Crawlberg

    MCP server

    Open-source crawler that turns websites into Markdown and JSON, with a local MCP server

    Runs locally
    • Open source
    • Web search and scraping
  11. shortfree

    MCP server

    Checks live whether short .com, .ai, .io and other domains are free; suggests free ones

    Runs locally
    • Open source
    • Developer tools
  12. Flop Scout

    MCP server

    Search, page reading and FLOP miner rankings that AI agents pay for per call

    Not checked yet
    • Remote
    • Open source
    • Web search and scraping
  13. Honestkit MCP

    MCP server

    18 Apify-backed web data tools: WHOIS, DNS, SEO audits, app store ranks, company lookups

    Runs locally
    • 14 tools
    • Open source
    • Web search and scraping
  14. Check whether Chinese, Japanese and Korean page titles fit Google by pixel width

    Runs locally
    • 2 tools
    • Open source
    • Web search and scraping
  15. RootMention SEO

    MCP server

    Remote MCP server giving AI assistants a free SEO audit, break-even calculator and plan

    Not checked yet
    • 3 tools
    • Remote
    • Open source
    • Web search and scraping
  16. WebRouter

    MCP server

    Open source Python interface for web search, extraction and browsing across many providers

    Runs locally
    • Open source
    • Web search and scraping
  17. API Screenshot

    MCP server

    Open-source screenshot API that removes cookie banners and pop-ups, for Cloudflare

    Not checked yet
    • 2 tools
    • Remote
    • Open source
    • Web search and scraping
  18. Google News

    MCP server

    MCP server that lets AI assistants search Google News by keyword, date, country or topic

    Runs locally
    • 2 tools
    • Open source
    • Web search and scraping
  19. Keyless web, news, image, video and book search for AI agents, via MCP or REST

    Runs locally
    • Open source
    • Web search and scraping
  20. searchio

    MCP server

    Keyless web search, page reading and product lookup for agents, with a bot-wall ladder

    Runs locally
    • Open source
    • Web search and scraping
  21. RoamProxy

    MCP server

    Fetch pages and build proxy URLs through residential, datacenter and mobile IPs worldwide

    Runs locally
    • 4 tools
    • Open source
    • Web search and scraping