Skip to content

AI for web search and scraping

16 AI tools, agents, MCP servers and skills for web search and scraping, with pricing, platforms and alternatives for each.

Showing 1–16 of 16

  1. llms.ink

    MCP server

    Turn any website, GitHub repo, PDF or video link into llms.txt or llms-full.txt

    • 7 tools
    • Remote
    • Free
    • AI models and LLM tooling
  2. CheckAnySite

    MCP server

    Ask an agent what a website is: AI builder traces, tech stack, traffic rank and trust

    • 6 tools
    • Remote
    • Free
    • Analytics and data
  3. proxy-scraper

    MCP server

    Hourly-checked free HTTP and SOCKS proxy lists with a CLI and MCP tools to fetch pages

    Runs locally
    • Free
    • Web search and scraping
  4. OmniSeek

    MCP server

    Search podcasts, videos, Chinese forums and paper citations from your coding agent

    Not checked yet
    • Remote
    • Free
    • Web search and scraping
  5. Search 1,500+ indie-made products as alternatives to big-name software from your AI

    Not checked yet
    • 4 tools
    • Remote
    • Free
    • Web search and scraping
  6. MakerRadar

    MCP server

    Search launched products, alternatives and weekly launch boards on MakerRadar

    Not checked yet
    • 14 tools
    • Remote
    • Free
    • Web search and scraping
  7. Nymwell Lookup

    MCP server

    Check domain availability and registrar prices and look up public domain records

    Not checked yet
    • 3 tools
    • Remote
    • Free
    • Web search and scraping
  8. MCP Lyricscom

    MCP server

    Find songs by a remembered lyric or title and read lyrics from lyrics.com

    Runs locally
    • 3 tools
    • Free
    • Events and entertainment
  9. Query a 30-question benchmark of You.com, Tavily, Exa and Parallel search APIs

    Not checked yet
    • 12 tools
    • Remote
    • Free
    • Web search and scraping
  10. free-web-mcp

    MCP server

    Keyless web search and page reading for agents using r.jina.ai, Wikipedia, HN and GitHub

    Not checked yet
    • 5 tools
    • Remote
    • Free
    • Web search and scraping
  11. Anclum

    MCP server

    Search a catalogue of MCP servers, agent skills and open-source AI projects

    Not checked yet
    • 3 tools
    • Remote
    • Free
    • Community directories
  12. Local research workspace that tracks sources, claims and gaps for your AI agent

    Runs locally
    • 5 tools
    • Free
    • Web search and scraping
  13. Private web search with no API key, plus Moshpit name lookups and a pro directory

    Runs locally
    • 7 tools
    • Free
    • Web search and scraping
  14. FrankenSurf

    MCP server

    Reads web pages with the cheapest tool that works, then checks the page is real

    Runs locally
    • Free
    • Web search and scraping
  15. 50+ developer utility APIs as tools: SSL, DNS, WHOIS, email checks, HTML to PDF and more

    Runs locally
    • 14 tools
    • Free
    • Developer tools