Skip to content

AI tools and MCP servers for rag

63 MCP servers and 3 AI tools for rag in web search and scraping, including crawl4ai, Atlas and Web Search API, most popular first. 8 of the 66 are listed as free or open source. Each one is written up from its own site or README, with pricing, platforms and alternatives.

Showing 1–30 of 66

  1. Web crawler and hosted API that turns URLs into LLM-ready Markdown or JSON

    • Freemium
    • Open-source agent
    • 87.6K GitHub stars
    • Web search and scraping
  2. Turns public web pages into clean Markdown and typed IR for developers

    • Freemium
    • Hosted agent
    • 3 Hacker News points
    • Web search and scraping
  3. Web Search API

    MCP server

    Bing and DuckDuckGo search results with page text, pay-per-query, for AI agents and RAG

    • Remote
    • Paid
    • Web search and scraping
  4. Converts web pages or whole sites to LLM-ready Markdown for RAG pipelines and AI agents

    • Remote
    • Paid
    • Web search and scraping
  5. Webshift

    MCP server

    Rust MCP server that cleans and reranks web pages into compact text for AI agents

    Not checked yet
    • 3 tools
    • Open source
    • Web search and scraping
  6. Web search and content extraction API that feeds live, structured results to AI agents

    • Freemium
    • Hosted agent
    • Web search and scraping
  7. Converts web pages into clean Markdown or plain text for LLMs, RAG and agents

    • Remote
    • Paid
    • Web search and scraping
  8. Turn YouTube captions, PDFs and web pages into clean Markdown for RAG

    • Remote
    • Freemium
    • Knowledge and memory
  9. Turn audio, images, PDFs, video and web pages into text an agent can read

    • 6 tools
    • Remote
    • Freemium
    • Files and documents
  10. Pay-per-call URL-to-Markdown, B2B enrichment and bounty feeds for agents via x402

    • 8 tools
    • Remote
    • Freemium
    • Web search and scraping
  11. Hosted and open-source web scraper that returns clean Markdown with change tracking

    • Remote
    • Free trial
    • Web search and scraping
  12. Distill MCP

    MCP server

    Fetch web pages as clean Markdown for agents, honouring robots.txt and noai

    Runs locally
    • 2 tools
    • Freemium
    • Web search and scraping
  13. Octocrawl

    MCP server

    Web scraping, mapping and crawling MCP server that returns clean Markdown

    Not checked yet
    • 2 tools
    • Remote
    • Freemium
    • Web search and scraping
  14. Remote MCP endpoint for Olostep's search, scrape and crawl API

    Not checked yet
    • Remote
    • Freemium
    • Web search and scraping
  15. Clawifi

    MCP server

    Web search, page and PDF reading, and passage extraction with sources for agents

    • 15 tools
    • Remote
    • Freemium
    • Web search and scraping
  16. TranscriptYT

    MCP server

    YouTube transcripts, search and summaries for Claude, Cursor and Codex

    • 6 tools
    • Remote
    • Freemium
    • Design and media
  17. Keirolabs

    MCP server

    Web search, Google results, page-to-markdown extraction and cited answers for agents

    • Remote
    • Freemium
    • Web search and scraping
  18. Crawl a site into clean, main-content Markdown for RAG, with linked documents converted

    • Remote
    • Paid
    • Web search and scraping
  19. MCP

    MCP server

    Scrape pages and map sites from an agent, processed on EU servers

    Runs locally
    • 1 tool
    • Freemium
    • Web search and scraping
  20. SearchPipe

    MCP server

    Live web search with quoted evidence and source authority tiers for agents

    • 3 tools
    • Remote
    • Freemium
    • Web search and scraping

Questions about AI tools and MCP servers for rag

What are the best AI tools and MCP servers for rag?

The most popular AI tools and MCP servers for rag on AI-Powered right now are crawl4ai, Atlas, Web Search API, Website to Markdown and Webshift. Rankings combine upvotes, recent activity and, for open-source projects, GitHub stars.

Are there free AI tools and MCP servers for rag?

Yes. Of the 66 AI tools and MCP servers for rag listed, 8 are free or open source and 32 have a free plan. Use the Pricing filter to see only those.

How many AI tools and MCP servers for rag are there?

AI-Powered lists 66 AI tools and MCP servers for rag. New listings are added daily from the official MCP Registry, GitHub and maker submissions.