
Web crawler and hosted API that turns URLs into LLM-ready Markdown or JSON
- Freemium
- Open-source agent
- 87.5K GitHub stars
- Web search and scraping

Web crawler and hosted API that turns URLs into LLM-ready Markdown or JSON
Split Markdown into heading-aware chunks for RAG, with paths and line numbers
Runs locallyLocal-first memory for agents that cites sources and says when it doesn't know
Runs locallyOffline, citation-grounded GraphRAG over a local knowledge graph, run via Ollama
Runs locallyAgent memory in SQLite or Postgres that flags stale facts and abstains when unsure
Runs locally
Rust build of Microsoft's markitdown that turns documents and web pages into Markdown
Runs locallyLocal-first knowledge graph engine with GraphRAG search and a 46-tool MCP server
Runs locallyConvert PDF, DOCX, XLSX and other files to Markdown with no key or account
Not checked yet23 pay-per-call AI APIs for agents, paid in USDC on Base with the x402 protocol
Not checked yetPersistent shared memory for agents that recalls before acting and learns from outcomes
Not checked yetSearch, buy and verify rights-cleared publisher content for AI agents
Not checked yetLocal long-term memory for agents that returns the relevant context within a token budget
Runs locallyGives agents a PDF's heading tree and section text so they read only what they need
Runs locallyContext control plane that picks the most useful retrieved passages under a token budget
Runs locally
Filter search results, code and logs into compact evidence packets for agents
Runs locallyLocal MCP server giving editors image, video, RAG and code-map tools from Guaardvark
Runs locallyTurn web pages into clean Markdown or token-sized RAG chunks via the Web2MD API
Runs locallyPolicy-enforced, permission-aware retrieval over your vector databases for agents
Runs locallyMCP and proxy that compresses coding-agent context before it reaches the model
Not checked yet
Context integrity checks for AI agents: freshness, provenance and confidence
Not checked yetLocal MCP server that reranks and trims RAG context to cut tokens before an LLM call
Runs locally