Skip to content
MCP server

Together AI MCP by usefulapi

Run Together AI chat, embeddings and images; manage fine-tunes, batches and endpoints.

Install
Runs
Remotely
Version
1.40.0
Listing updated
4 days ago

About Together AI MCP by usefulapi

Together AI MCP by usefulapi is an MCP server. It runs as a hosted remote server, so there is nothing to install locally.

Install

Run in a terminal

claude mcp add --transport http together-ai https://together-ai.usefulapi.io/mcp

Add to Settings → Connectors → Add custom connector

https://together-ai.usefulapi.io/mcp
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "together-ai": {
      "url": "https://together-ai.usefulapi.io/mcp"
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "together-ai": {
      "type": "http",
      "url": "https://together-ai.usefulapi.io/mcp"
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "together-ai": {
      "serverUrl": "https://together-ai.usefulapi.io/mcp"
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "together-ai": {
      "type": "http",
      "url": "https://together-ai.usefulapi.io/mcp"
    }
  }
}

Tools this server provides (23)

Read directly from the server.

together_whoami
Identify the API key: its organization, project and project slug. The project slug forms the `<project_slug>/<endpoint_slug>` model name for dedicated-endpoint inference. A cheap way to confirm the key works. Together: GET /whoami.
together_list_models
List Together's models with type (chat, language, code, image, embedding, moderation, rerank), context length, organization, license and per-token pricing. Together: GET /models.
together_list_files
List uploaded data files (fine-tune, eval and batch-api inputs, plus job outputs) with size, type, purpose and validation status. Together: GET /files.
together_get_file
Fetch one file's metadata, including its processing_status and validation_report (why a fine-tune training file was rejected). Together: GET /files/{id}.
together_list_fine_tunes
List fine-tuning jobs with status, base model, output model name and training settings. Together: GET /fine-tunes.
together_get_fine_tune
Fetch one fine-tuning job: status, progress, hyperparameters, token counts, cost and the output model name. Together: GET /fine-tunes/{id}.
together_list_fine_tune_events
List the event log of one fine-tuning job (queued, started, checkpoint saved, epoch completed, errors). The first place to look when a job failed. Together: GET /fine-tunes/{id}/events.
together_list_batches
List batch inference jobs with status, progress, model and input/output/error file ids. Together: GET /batches.
together_get_batch
Fetch one batch job: status (VALIDATING, IN_PROGRESS, COMPLETED, FAILED, EXPIRED, CANCELLED), progress, and the output_file_id / error_file_id once done. Together: GET /batches/{id}.
together_list_endpoints
List endpoints with model, owner and state (PENDING, STARTING, STARTED, STOPPING, STOPPED, ERROR). Use mine=true and type=dedicated to see what is running on your account and billing by the minute. Together: GET /endpoints.
together_get_endpoint
Fetch one dedicated endpoint: state, model, hardware, autoscaling bounds and display name. Together: GET /endpoints/{endpointId}.
together_list_hardware
List hardware configurations for dedicated endpoints with GPU type/count/memory and price in cents per minute. Pass a model to get only compatible configurations with live availability. Together: GET /hardware.
together_list_evaluations
List LLM-as-a-judge evaluation jobs (classify, score, compare) with status, parameters and results once completed. Together: GET /evaluation.
together_chat_completion
Run a chat completion on a Together model (billed per token). Non-streaming. For a dedicated endpoint pass its `<project_slug>/<endpoint_slug>` as the model. Together: POST /chat/completions.
together_create_embeddings
Generate vector embeddings for one or more texts (billed per token). Together: POST /embeddings.
together_generate_image
Generate images from a prompt (billed per image/megapixel). Returns image URLs by default rather than base64, to keep responses small. Together: POST /images/generations.
together_create_fine_tune
Start a fine-tuning job on an uploaded training file (billed per token processed). Stop it with together_cancel_fine_tune. Together: POST /fine-tunes.
together_cancel_fine_tune
Cancel a running fine-tuning job. Cannot be resumed, but a new job can continue from its last checkpoint via from_checkpoint. Together: POST /fine-tunes/{id}/cancel.
together_create_batch
Start an asynchronous batch job over an uploaded JSONL input file (purpose batch-api), at a discount to real-time inference. Together: POST /batches.
together_cancel_batch
Cancel a batch job that has not finished. Together: POST /batches/{id}/cancel.
together_create_endpoint
Deploy a model on dedicated GPUs. The endpoint STARTS AUTOMATICALLY and bills per minute of uptime until stopped — set inactive_timeout to auto-stop it, and use together_list_hardware for valid hardware ids. Together: POST /endpoints.
together_start_endpoint
Start a stopped dedicated endpoint. It bills per minute of uptime until stopped. Reversible with together_stop_endpoint. Together: PATCH /endpoints/{endpointId} with state=STARTED.
together_stop_endpoint
Stop a running dedicated endpoint, which stops its per-minute billing. Requests to it fail until it is started again. Together: PATCH /endpoints/{endpointId} with state=STOPPED.

Together AI MCP by usefulapi FAQ

How do I add Together AI MCP by usefulapi to Claude Code?

Run this command in your terminal: claude mcp add --transport http together-ai https://together-ai.usefulapi.io/mcp