
anything-llm
Private on-device AI assistant for chatting with documents, with local models
- Pricing
- Free
- Platforms
- macOS, Windows, Linux
- GitHub stars
- 68.3K
- Last commit
- today
- Language
- JavaScript
- License
- MIT
About anything-llm
anything-llm is a free AI tool for personal assistants. It is available on macOS, Windows, Linux, Android and API.
AnythingLLM runs on your computer and keeps documents local, so every file you add becomes part of the assistant's knowledge base without leaving the device. The site says no accounts, API keys or token limits are needed, and the installer is a single file for macOS, Windows and Linux.
On first run you pick a model or let the app recommend one for your hardware. A Meeting Assistant transcribes and summarises calls locally, with no bot joining the meeting, and a mouse-pointer feature refines dictated text using what is on screen. The blog notes the built-in engine now uses llama.cpp managed by AMD's Lemonade, support for Microsoft Foundry Local on Windows, and You.com web search on by default.
A custom tool builder and developer API extend it, and an Android app runs small models on the phone.
What it does
- On-device models
- Runs and picks local models for your hardware.
- Document chat
- Adds your files as private knowledge.
- Meeting Assistant
- Local transcripts, summaries and action items.
- Tool builder and API
- Extend the assistant with custom tools.
- Android app
- Small models on the phone, pairable with desktop.
Good for
- Ask questions about private documents
- Summarise meetings without a cloud bot
- Dictate and refine text at the cursor
- Build custom tools for a local assistant
Pricing
Free
Site describes it as free; MIT repository
Prices change. Check anythingllm.com before you buy.
anything-llm FAQ
Does it need an account?
The site says no accounts or API keys are needed.
Which systems are supported?
macOS, Windows and Linux, plus an Android app.
Is it open source?
The repository lists the MIT license.
Is anything-llm free?
Yes. anything-llm is free to use.
What are the best alternatives to anything-llm?
The closest alternatives to anything-llm are graphify, JavaGuide, claude-mem, ragflow and hindsight.
Alternatives to anything-llm

Code knowledge graph that gives coding assistants shared, source-linked context
- Freemium
- Open-source agent
- 149K GitHub stars
- Knowledge and memory

Chinese-language Java backend interview guide with an AI application section
- Free
- Open-source agent
- 160K GitHub stars
- Knowledge and memory

Memory for coding agents that saves decisions and fixes, with optional hosted sync
- Freemium
- Open-source agent
- 118K GitHub stars
- Knowledge and memory

Open-source RAG engine with a document pipeline, hybrid search and visual agent workflows
- Freemium
- Open-source agent
- 94.3K GitHub stars
- Knowledge and memory

Long-term memory layer for AI agents that stores typed facts and consolidates beliefs
- Open source
- Open-source agent
- 61.4K GitHub stars
- Knowledge and memory

Local-first, privacy-focused note-taking app with block references and encrypted sync
- Open source
- Open-source agent
- 47.3K GitHub stars
- Knowledge and memory