Skip to content
ToolOpen-source agent

anything-llm

Private on-device AI assistant for chatting with documents, with local models

Pricing
Free
Platforms
macOS, Windows, Linux
GitHub stars
68.3K
Last commit
today
Language
JavaScript
License
MIT

About anything-llm

anything-llm is a free AI tool for personal assistants. It is available on macOS, Windows, Linux, Android and API.

AnythingLLM runs on your computer and keeps documents local, so every file you add becomes part of the assistant's knowledge base without leaving the device. The site says no accounts, API keys or token limits are needed, and the installer is a single file for macOS, Windows and Linux.

On first run you pick a model or let the app recommend one for your hardware. A Meeting Assistant transcribes and summarises calls locally, with no bot joining the meeting, and a mouse-pointer feature refines dictated text using what is on screen. The blog notes the built-in engine now uses llama.cpp managed by AMD's Lemonade, support for Microsoft Foundry Local on Windows, and You.com web search on by default.

A custom tool builder and developer API extend it, and an Android app runs small models on the phone.

What it does

On-device models
Runs and picks local models for your hardware.
Document chat
Adds your files as private knowledge.
Meeting Assistant
Local transcripts, summaries and action items.
Tool builder and API
Extend the assistant with custom tools.
Android app
Small models on the phone, pairable with desktop.

Good for

  • Ask questions about private documents
  • Summarise meetings without a cloud bot
  • Dictate and refine text at the cursor
  • Build custom tools for a local assistant

Pricing

Free

Site describes it as free; MIT repository

Prices change. Check anythingllm.com before you buy.

anything-llm FAQ

Does it need an account?

The site says no accounts or API keys are needed.

Which systems are supported?

macOS, Windows and Linux, plus an Android app.

Is it open source?

The repository lists the MIT license.

Is anything-llm free?

Yes. anything-llm is free to use.

What are the best alternatives to anything-llm?

The closest alternatives to anything-llm are graphify, JavaGuide, claude-mem, ragflow and hindsight.

Alternatives to anything-llm

  1. Code knowledge graph that gives coding assistants shared, source-linked context

    • Freemium
    • Open-source agent
    • 149K GitHub stars
    • Knowledge and memory
  2. Chinese-language Java backend interview guide with an AI application section

    • Free
    • Open-source agent
    • 160K GitHub stars
    • Knowledge and memory
  3. Memory for coding agents that saves decisions and fixes, with optional hosted sync

    • Freemium
    • Open-source agent
    • 118K GitHub stars
    • Knowledge and memory
  4. Open-source RAG engine with a document pipeline, hybrid search and visual agent workflows

    • Freemium
    • Open-source agent
    • 94.3K GitHub stars
    • Knowledge and memory
  5. Long-term memory layer for AI agents that stores typed facts and consolidates beliefs

    • Open source
    • Open-source agent
    • 61.4K GitHub stars
    • Knowledge and memory
  6. Local-first, privacy-focused note-taking app with block references and encrypted sync

    • Open source
    • Open-source agent
    • 47.3K GitHub stars
    • Knowledge and memory