Skip to content

AI tools and MCP servers for rag

63 MCP servers and 3 AI tools for rag in web search and scraping, including crawl4ai, Atlas and Web Search API, most popular first. 8 of the 66 are listed as free or open source. Each one is written up from its own site or README, with pricing, platforms and alternatives.

Showing 31–60 of 66

  1. DeepSift Search

    MCP server

    Web search for agents that returns only the answering passages, in Tavily's format

    Not checked yet
    • 4 tools
    • Remote
    • Freemium
    • Web search and scraping
  2. webclaw

    MCP server

    Scrape, crawl, search and extract web pages as clean Markdown or JSON for agents

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  3. Readmd

    MCP server

    Turn any web page into clean Markdown with an outline and token counts, per page

    Not checked yet
    • 3 tools
    • Remote
    • Paid
    • Web search and scraping
  4. 15 pay-per-event data APIs for Maps, social, RAG, reviews, fuel and AI visibility

    Not checked yet
    • Remote
    • Paid
    • Web search and scraping
  5. Convert web pages, PDFs and small sites into clean Markdown with chunks for RAG

    Not checked yet
    • 1 tool
    • Remote
    • Paid
    • Files and documents
  6. Turns web pages and PDFs into clean Markdown and strips hidden prompt-injection text

    Not checked yet
    • Remote
    • Paid
    • Web search and scraping
  7. Reddit Data

    MCP server

    Reddit posts, comments, keyword search and archives as four Apify scraper tools

    Not checked yet
    • 4 tools
    • Remote
    • Freemium
    • Web search and scraping
  8. Crawlberg

    MCP server

    Open-source crawler that turns websites into Markdown and JSON, with a local MCP server

    Runs locally
    • Open source
    • Web search and scraping
  9. Web2md

    MCP server

    Convert a public URL to clean Markdown, with a free tier of 10 requests a day

    Not checked yet
    • 1 tool
    • Remote
    • Freemium
    • Web search and scraping
  10. CleanText

    MCP server

    Extract article text or Markdown from public web pages via one call

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  11. Web search and URL-to-markdown for agents at $0.002 per page, failed reads free

    Not checked yet
    • 1 tool
    • Remote
    • Paid
    • Web search and scraping
  12. TranscriptFetch

    MCP server

    Remote MCP server for timestamped YouTube, TikTok and Instagram video transcripts

    Not checked yet
    • 7 tools
    • Remote
    • Freemium
    • Design and media
  13. ContextFetch

    MCP server

    Web search and page-to-Markdown for agents, with a free keyless tier

    Not checked yet
    • 11 tools
    • Remote
    • Freemium
    • Web search and scraping
  14. Argus Retrieval

    MCP server

    Search broker over 14 providers with page extraction, dead-link recovery, research packs

    Runs locally
    • Open source
    • Knowledge and memory
  15. Web2MD

    MCP server

    Turn web pages into clean Markdown or token-sized RAG chunks via the Web2MD API

    Runs locally
    • 4 tools
    • Freemium
    • Web search and scraping
  16. Download transcripts of every video of a YouTube channel or playlist, new ones only

    Not checked yet
    • Remote
    • Paid
    • Design and media
  17. Transcripts of top YouTube search results by keyword, with date, length and sort filters

    Not checked yet
    • Remote
    • Paid
    • Design and media
  18. DeepSFetch

    MCP server

    Scrape, search and extract web data as Markdown or validated JSON, with credit caps

    Not checked yet
    • Remote
    • Paid
    • Web search and scraping
  19. Opensolr MCP

    MCP server

    Hybrid keyword and semantic search, indexing and RAG answers over Opensolr Solr indexes

    Runs locally
    • 15 tools
    • Freemium
    • Knowledge and memory
  20. Transcripts of YouTube videos, channels, playlists and searches, with AI when no captions

    Not checked yet
    • 1 tool
    • Remote
    • Freemium
    • Design and media
  21. Google News search and topic feeds with full article text as Markdown for LLM pipelines

    Not checked yet
    • Remote
    • Paid
    • Web search and scraping
  22. PyreCrawl

    MCP server

    Self-hosted MCP server giving AI agents web scraping, crawling and search without API keys

    Runs locally
    • 13 tools
    • Open source
    • Web search and scraping
  23. EnConvert

    MCP server

    Read any web page as Markdown or JSON with a render-quality score that flags blocked pages

    Runs locally
    • Freemium
    • Web search and scraping
  24. Apify-hosted MCP endpoint exposing seven Signal Lab data-extraction Actors to AI agents

    Not checked yet
    • 7 tools
    • Remote
    • Communication
  25. Web-grounded AI answers with citations via API and MCP, priced per answer

    Runs locally
    • 5 tools
    • Freemium
    • Web search and scraping