Skip to content

AI tools, agents, MCP servers and skills for web search and scraping

1,212 MCP servers, 15 agent skills, 6 AI tools and 2 AI agents for web search and scraping, including Scrapling MCP Server, Competitor profiling and firecrawl. Each listing shows pricing, platforms and alternatives; use the kind links to see only one kind.

Showing 1–20 of 20

  1. llms.ink

    MCP server

    Turn any website, GitHub repo, PDF or video link into llms.txt or llms-full.txt

    • 7 tools
    • Remote
    • Free
    • AI models and LLM tooling
  2. CheckAnySite

    MCP server

    Ask an agent what a website is: AI builder traces, tech stack, traffic rank and trust

    • 6 tools
    • Remote
    • Free
    • Analytics and data
  3. proxy-scraper

    MCP server

    Hourly-checked free HTTP and SOCKS proxy lists with a CLI and MCP tools to fetch pages

    Runs locally
    • Free
    • Web search and scraping
  4. OmniSeek

    MCP server

    Search podcasts, videos, Chinese forums and paper citations from your coding agent

    Not checked yet
    • Remote
    • Free
    • Web search and scraping
  5. Search 1,500+ indie-made products as alternatives to big-name software from your AI

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • Web search and scraping
  6. MakerRadar

    MCP server

    Search launched products, alternatives and weekly launch boards on MakerRadar

    Not checked yet
    • 14 tools
    • Remote
    • Free
    • Web search and scraping
  7. Nymwell Lookup

    MCP server

    Check domain availability and registrar prices and look up public domain records

    Not checked yet
    • 3 tools
    • Remote
    • Free
    • Web search and scraping
  8. MCP Lyricscom

    MCP server

    Find songs by a remembered lyric or title and read lyrics from lyrics.com

    Runs locally
    • 3 tools
    • Free
    • Events and entertainment
  9. Anonymous, no-key MCP server for SEO and AI crawler checks, robots.txt and llms.txt

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • Web search and scraping
  10. FFraud

    MCP server

    Remote MCP server giving AI assistants free checks on websites, IPs, emails and domains

    Not checked yet
    • 7 tools
    • Remote
    • Free
    • Web search and scraping
  11. Query a 30-question benchmark of You.com, Tavily, Exa and Parallel search APIs

    Not checked yet
    • 12 tools
    • Remote
    • Free
    • Web search and scraping
  12. free-web-mcp

    MCP server

    Keyless web search and page reading for agents using r.jina.ai, Wikipedia, HN and GitHub

    Not checked yet
    • 5 tools
    • Remote
    • Free
    • Web search and scraping
  13. Anclum

    MCP server

    Search a catalogue of MCP servers, agent skills and open-source AI projects

    Not checked yet
    • 3 tools
    • Remote
    • Free
    • Community directories
  14. Local research workspace that tracks sources, claims and gaps for your AI agent

    Runs locally
    • 5 tools
    • Free
    • Web search and scraping
  15. Private web search with no API key, plus Moshpit name lookups and a pro directory

    Runs locally
    • 7 tools
    • Free
    • Web search and scraping
  16. FrankenSurf

    MCP server

    Reads web pages with the cheapest tool that works, then checks the page is real

    Runs locally
    • Free
    • Web search and scraping
  17. Checks whether a website is down for everyone or only for you, with HTTP code and timing

    Not checked yet
    • 1 tool
    • Remote
    • Free
    • Web search and scraping
  18. 50+ developer utility APIs as tools: SSL, DNS, WHOIS, email checks, HTML to PDF and more

    Runs locally
    • 14 tools
    • Free
    • Developer tools