Skip to content
MCP server

Onde Inference CLI: Fine-tune & Deploy Local LLMs

Fine-tune Qwen models with LoRA, export GGUF and manage Onde apps from an agent

Runs locallyStatus and history
Install
Pricing
Open source
Platforms
CLI, macOS, Linux
Runs
Locally
Version
0.5.1
Listing updated
3 days ago

About Onde Inference CLI: Fine-tune & Deploy Local LLMs

Onde Inference CLI: Fine-tune & Deploy Local LLMs is an open-source MCP server for ai models and llm tooling. It runs locally on your machine and is started by your AI client.

onde is the command-line client for Onde Inference, and running it with the MCP flag serves its functions to an agent over stdio. The same binary opens a terminal UI for signing in and managing apps and the model catalog.

Its local workflow picks a safetensors model, starts a LoRA run on your machine, merges the adapter into the base model and exports GGUF for local inference or packaging. The README names Qwen models as the supported fine-tuning targets. Training data, model files and logs stay in one place on your computer.

It installs through Homebrew, npm, Cargo, pip or uv, NuGet, Dart pub and prebuilt binaries. The code is dual-licensed under MIT and Apache 2.0. The wider Onde platform has separate paid options, such as per-device plans and a pay-per-token cloud endpoint, which are not needed to use the CLI.

Install

Run in a terminal

claude mcp add onde-cli -- npx -y @ondeinference/cli

Add to claude_desktop_config.json

{
  "mcpServers": {
    "onde-cli": {
      "command": "npx",
      "args": [
        "-y",
        "@ondeinference/cli"
      ]
    }
  }
}
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "onde-cli": {
      "command": "npx",
      "args": [
        "-y",
        "@ondeinference/cli"
      ]
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "onde-cli": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "@ondeinference/cli"
      ]
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "onde-cli": {
      "command": "npx",
      "args": [
        "-y",
        "@ondeinference/cli"
      ]
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "onde-cli": {
      "command": "npx",
      "args": [
        "-y",
        "@ondeinference/cli"
      ]
    }
  }
}

What it does

Terminal UI
Sign in and manage your account, apps and models from the terminal.
Local LoRA tuning
Fine-tune supported Qwen models on your own machine.
Adapter merge
Merge the adapter back into the base model.
GGUF export
Export the merged model for local inference.
MCP mode
Run as an MCP server over stdio for agents.
Many install routes
Homebrew, npm, Cargo, pip, NuGet, Dart pub and binaries.

Good for

  • Fine-tune a small model on a Mac
  • Export a model to GGUF for an app
  • Let an agent manage Onde apps and models
  • Prepare a model to ship on-device

Pricing

Open source

Free CLI; Onde Cloud billed per million tokens

Prices change. Check ondeinference.com before you buy.

Onde Inference CLI: Fine-tune & Deploy Local LLMs FAQ

How do I start the MCP server?

Run onde --mcp for a stdio server.

Which models can I tune?

The README says Qwen models, using LoRA.

What license is it?

Dual-licensed under MIT and Apache 2.0.

Does the CLI cost money?

Install pricing is not listed; Onde's paid plans apply to its device fleet and cloud endpoint.

Is Onde Inference CLI: Fine-tune & Deploy Local LLMs free?

Yes. Onde Inference CLI: Fine-tune & Deploy Local LLMs is open source, so you can use and self-host it for free.

How do I add Onde Inference CLI: Fine-tune & Deploy Local LLMs to Claude Code?

Run this command in your terminal: claude mcp add onde-cli -- npx -y @ondeinference/cli

What are the best alternatives to Onde Inference CLI: Fine-tune & Deploy Local LLMs?

The closest alternatives to Onde Inference CLI: Fine-tune & Deploy Local LLMs are REA, Codebase Memory, GitHub, Serena MCP: the IDE for your agent and XERJ.

Alternatives to Onde Inference CLI: Fine-tune & Deploy Local LLMs

  1. REA

    MCP server

    CLI and MCP server that lets coding agents reverse engineer apps and binaries

    Runs locally
    • Open source
    • 464K GitHub stars
    • Developer tools
  2. Codebase Memory

    MCP server

    Local MCP server that builds a code knowledge graph for AI coding agents

    Runs locally
    • Open source
    • 48.7K GitHub stars
    • Knowledge and memory
  3. GitHub

    MCP server

    Official MCP server connecting AI assistants to GitHub repos, issues and workflows

    Not checked yet
    • Remote
    • Open source
    • 34.5K GitHub stars
    • Developer tools
  4. MCP toolkit giving coding agents symbol-level code retrieval and editing

    Runs locally
    • Open source
    • 31.5K GitHub stars
    • Developer tools
  5. XERJ

    MCP server

    Local search engine for AI agents with cited answers over your code and docs

    Runs locally
    • Open source
    • 19.2K GitHub stars
    • Knowledge and memory
  6. Ouroboros

    MCP server

    Spec-first layer that pins requirements and verifies results of AI coding agent work

    Runs locally
    • Open source
    • 6.4K GitHub stars
    • Developer tools