Onde Inference CLI: Fine-tune & Deploy Local LLMs
Fine-tune Qwen models with LoRA, export GGUF and manage Onde apps from an agent
- Pricing
- Open source
- Platforms
- CLI, macOS, Linux
- Runs
- Locally
- Version
- 0.5.1
- Listing updated
- 3 days ago
About Onde Inference CLI: Fine-tune & Deploy Local LLMs
Onde Inference CLI: Fine-tune & Deploy Local LLMs is an open-source MCP server for ai models and llm tooling. It runs locally on your machine and is started by your AI client.
onde is the command-line client for Onde Inference, and running it with the MCP flag serves its functions to an agent over stdio. The same binary opens a terminal UI for signing in and managing apps and the model catalog.
Its local workflow picks a safetensors model, starts a LoRA run on your machine, merges the adapter into the base model and exports GGUF for local inference or packaging. The README names Qwen models as the supported fine-tuning targets. Training data, model files and logs stay in one place on your computer.
It installs through Homebrew, npm, Cargo, pip or uv, NuGet, Dart pub and prebuilt binaries. The code is dual-licensed under MIT and Apache 2.0. The wider Onde platform has separate paid options, such as per-device plans and a pay-per-token cloud endpoint, which are not needed to use the CLI.
Install
Run in a terminal
claude mcp add onde-cli -- npx -y @ondeinference/cliAdd to claude_desktop_config.json
{
"mcpServers": {
"onde-cli": {
"command": "npx",
"args": [
"-y",
"@ondeinference/cli"
]
}
}
}Add to ~/.cursor/mcp.json
{
"mcpServers": {
"onde-cli": {
"command": "npx",
"args": [
"-y",
"@ondeinference/cli"
]
}
}
}Add to .vscode/mcp.json
{
"servers": {
"onde-cli": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"@ondeinference/cli"
]
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"onde-cli": {
"command": "npx",
"args": [
"-y",
"@ondeinference/cli"
]
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"onde-cli": {
"command": "npx",
"args": [
"-y",
"@ondeinference/cli"
]
}
}
}What it does
- Terminal UI
- Sign in and manage your account, apps and models from the terminal.
- Local LoRA tuning
- Fine-tune supported Qwen models on your own machine.
- Adapter merge
- Merge the adapter back into the base model.
- GGUF export
- Export the merged model for local inference.
- MCP mode
- Run as an MCP server over stdio for agents.
- Many install routes
- Homebrew, npm, Cargo, pip, NuGet, Dart pub and binaries.
Good for
- Fine-tune a small model on a Mac
- Export a model to GGUF for an app
- Let an agent manage Onde apps and models
- Prepare a model to ship on-device
Pricing
Open source
Free CLI; Onde Cloud billed per million tokens
Prices change. Check ondeinference.com before you buy.
Onde Inference CLI: Fine-tune & Deploy Local LLMs FAQ
How do I start the MCP server?
Run onde --mcp for a stdio server.
Which models can I tune?
The README says Qwen models, using LoRA.
What license is it?
Dual-licensed under MIT and Apache 2.0.
Does the CLI cost money?
Install pricing is not listed; Onde's paid plans apply to its device fleet and cloud endpoint.
Is Onde Inference CLI: Fine-tune & Deploy Local LLMs free?
Yes. Onde Inference CLI: Fine-tune & Deploy Local LLMs is open source, so you can use and self-host it for free.
How do I add Onde Inference CLI: Fine-tune & Deploy Local LLMs to Claude Code?
Run this command in your terminal: claude mcp add onde-cli -- npx -y @ondeinference/cli
What are the best alternatives to Onde Inference CLI: Fine-tune & Deploy Local LLMs?
The closest alternatives to Onde Inference CLI: Fine-tune & Deploy Local LLMs are REA, Codebase Memory, GitHub, Serena MCP: the IDE for your agent and XERJ.
Alternatives to Onde Inference CLI: Fine-tune & Deploy Local LLMs

REA
MCP serverCLI and MCP server that lets coding agents reverse engineer apps and binaries
Runs locally- Open source
- 464K GitHub stars
- Developer tools

Codebase Memory
MCP serverLocal MCP server that builds a code knowledge graph for AI coding agents
Runs locally- Open source
- 48.7K GitHub stars
- Knowledge and memory

GitHub
MCP serverOfficial MCP server connecting AI assistants to GitHub repos, issues and workflows
Not checked yet- Remote
- Open source
- 34.5K GitHub stars
- Developer tools

Serena MCP: the IDE for your agent
MCP serverMCP toolkit giving coding agents symbol-level code retrieval and editing
Runs locally- Open source
- 31.5K GitHub stars
- Developer tools

XERJ
MCP serverLocal search engine for AI agents with cited answers over your code and docs
Runs locally- Open source
- 19.2K GitHub stars
- Knowledge and memory

Ouroboros
MCP serverSpec-first layer that pins requirements and verifies results of AI coding agent work
Runs locally- Open source
- 6.4K GitHub stars
- Developer tools