Skip to content
MCP server

RemoveDuplicates.org

Remove duplicate lines or CSV and TSV rows from text, processed per call and never stored

Install
Pricing
Open source
Platforms
API, Web
Runs
Remotely
Version
1.0.1
Listing updated
1 day ago

About RemoveDuplicates.org

RemoveDuplicates.org is an open-source MCP server for files and documents. It runs as a hosted remote server, so there is nothing to install locally.

This hosted server exposes the same deduplication engine as the RemoveDuplicates.org site through one read-only tool, remove_duplicates. It takes up to 128 KiB of text and returns the cleaned text with counts. Options include format (auto, lines or table), ignoreCase, trim, removeEmpty, which copy to keep (first or last), whether to preserve order or sort, which column or columns to compare (or the whole row), and whether the first row is a header.

Each call is processed in memory and nothing is stored. The MCP endpoint is the only part of the project that handles content on a server; the website itself works in browser memory and uploads nothing, and the README says there are no accounts, analytics scripts or advertising pixels. Excel workbooks are handled by a separate browser-only page that accepts macro-free .xlsx files, because the MCP tool takes pasted text rather than workbooks.

No key or install is needed. The README gives setup lines for Claude Code, Cline, Cursor, VS Code and Gemini CLI, and suggests npx mcp-remote for stdio-only clients. The project is MIT licensed and runs as a Cloudflare Worker.

Install

Run in a terminal

claude mcp add --transport http remove-duplicates https://removeduplicates.org/mcp

Add to Settings → Connectors → Add custom connector

https://removeduplicates.org/mcp
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "remove-duplicates": {
      "url": "https://removeduplicates.org/mcp"
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "remove-duplicates": {
      "type": "http",
      "url": "https://removeduplicates.org/mcp"
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "remove-duplicates": {
      "serverUrl": "https://removeduplicates.org/mcp"
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "remove-duplicates": {
      "type": "http",
      "url": "https://removeduplicates.org/mcp"
    }
  }
}

Tools this server provides (1)

Taken from the project documentation; the running server may differ.

remove_duplicates
Remove duplicate lines or table rows from text and return cleaned text with counts

What it does

Line deduplication
Removes repeated lines, keeping first or last copy.
Table-aware mode
Compares whole CSV or TSV rows or chosen columns.
Matching rules
Case-insensitive matching, trimming and empty-line removal.
Order control
Preserve original order or sort unique lines.
Stateless processing
Each call is handled in memory and nothing is stored.
No account
No key, sign-in or install needed for the hosted endpoint.

Good for

  • Clean a pasted list of URLs or names
  • Dedupe a CSV by one column
  • Remove repeated log lines
  • Tidy a copied spreadsheet range before importing it

Pricing

Open source

MIT licence; free, no key

Prices change. Check removeduplicates.org before you buy.

RemoveDuplicates.org FAQ

What is the size limit?

The tool accepts up to 128 KiB of text per call.

Is my text stored?

No. The server processes it in memory per call and stores nothing.

Can it process Excel files?

Not through MCP. A separate browser-only Excel tool handles .xlsx files.

What licence is it?

MIT.

Is RemoveDuplicates.org free?

Yes. RemoveDuplicates.org is open source, so you can use and self-host it for free.

How do I add RemoveDuplicates.org to Claude Code?

Run this command in your terminal: claude mcp add --transport http remove-duplicates https://removeduplicates.org/mcp

What are the best alternatives to RemoveDuplicates.org?

The closest alternatives to RemoveDuplicates.org are Ha MCP, Concord MCP, note1, ASTra and CalderFlow.

Alternatives to RemoveDuplicates.org

  1. Ha MCP

    MCP server

    MCP server for managing and automating Home Assistant from AI assistants

    Runs locally
    • 8 tools
    • Open source
    • 7.9K GitHub stars
    • Productivity
  2. Concord MCP

    MCP server

    Local-first MCP server for messaging and shared work-state between coding agents

    Runs locally
    • Freemium
    • 1.3K GitHub stars
    • Developer tools
  3. note1

    MCP server

    MCP server giving AI assistants search and summaries across your note1 meetings

    • 4 tools
    • Remote
    • Free trial
    • 1 GitHub star
    • Productivity
  4. ASTra

    MCP server

    Let agents read, edit, validate and undo Word .docx files with exact operations

    Runs locally
    • 5 tools
    • Freemium
    • Files and documents
  5. CalderFlow

    MCP server

    Turn notes or specs into editable flowcharts, timelines and funnels from an AI assistant

    • 10 tools
    • Remote
    • Free
    • Design and media
  6. CARTESIAN ECU

    MCP server

    Check and repair ECU and TCU flash-file checksums from Claude (Ultimate plan)

    Not checked yet
    • 5 tools
    • Remote
    • Paid
    • Files and documents