# RemoveDuplicates.org

> RemoveDuplicates.org is an open-source MCP server for files and documents. Remove duplicate lines or CSV and TSV rows from text, processed per call and never stored. It runs as a hosted remote server, so there is nothing to install locally.

- **Kind:** MCP server
- **Pricing:** Open source
- **Platforms:** API, Web
- **Website:** https://removeduplicates.org
- **Repository:** https://github.com/suvadadepolo-blip/remove-duplicates
- **MCP Registry name:** org.removeduplicates/remove-duplicates
- **Categories:** files and documents, productivity
- **Listing updated:** 2026-11-16

## About

This hosted server exposes the same deduplication engine as the RemoveDuplicates.org site through one read-only tool, remove_duplicates. It takes up to 128 KiB of text and returns the cleaned text with counts. Options include format (auto, lines or table), ignoreCase, trim, removeEmpty, which copy to keep (first or last), whether to preserve order or sort, which column or columns to compare (or the whole row), and whether the first row is a header.

Each call is processed in memory and nothing is stored. The MCP endpoint is the only part of the project that handles content on a server; the website itself works in browser memory and uploads nothing, and the README says there are no accounts, analytics scripts or advertising pixels. Excel workbooks are handled by a separate browser-only page that accepts macro-free .xlsx files, because the MCP tool takes pasted text rather than workbooks.

No key or install is needed. The README gives setup lines for Claude Code, Cline, Cursor, VS Code and Gemini CLI, and suggests npx mcp-remote for stdio-only clients. The project is MIT licensed and runs as a Cloudflare Worker.

## Features

- **Line deduplication:** Removes repeated lines, keeping first or last copy.
- **Table-aware mode:** Compares whole CSV or TSV rows or chosen columns.
- **Matching rules:** Case-insensitive matching, trimming and empty-line removal.
- **Order control:** Preserve original order or sort unique lines.
- **Stateless processing:** Each call is handled in memory and nothing is stored.
- **No account:** No key, sign-in or install needed for the hosted endpoint.

## Good for

- Clean a pasted list of URLs or names
- Dedupe a CSV by one column
- Remove repeated log lines
- Tidy a copied spreadsheet range before importing it

## Install

### Claude Code (Terminal)

```sh
claude mcp add --transport http remove-duplicates https://removeduplicates.org/mcp
```

### Claude Desktop (Settings → Connectors → Add custom connector)

```sh
https://removeduplicates.org/mcp
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "remove-duplicates": {
      "url": "https://removeduplicates.org/mcp"
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "remove-duplicates": {
      "type": "http",
      "url": "https://removeduplicates.org/mcp"
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "remove-duplicates": {
      "serverUrl": "https://removeduplicates.org/mcp"
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "remove-duplicates": {
      "type": "http",
      "url": "https://removeduplicates.org/mcp"
    }
  }
}
```

## Tools

- `remove_duplicates`: Remove duplicate lines or table rows from text and return cleaned text with counts

## FAQ

### What is the size limit?

The tool accepts up to 128 KiB of text per call.

### Is my text stored?

No. The server processes it in memory per call and stores nothing.

### Can it process Excel files?

Not through MCP. A separate browser-only Excel tool handles .xlsx files.

### What licence is it?

MIT.

### Is RemoveDuplicates.org free?

Yes. RemoveDuplicates.org is open source, so you can use and self-host it for free.

### How do I add RemoveDuplicates.org to Claude Code?

Run this command in your terminal: claude mcp add --transport http remove-duplicates https://removeduplicates.org/mcp

### What are the best alternatives to RemoveDuplicates.org?

The closest alternatives to RemoveDuplicates.org are Ha MCP, Concord MCP, note1, ASTra and CalderFlow.

## Alternatives

- [Ha MCP](https://ai-powered.com/mcp/ha-mcp): Ha MCP is an open-source MCP server for productivity.
- [Concord MCP](https://ai-powered.com/mcp/concord-mcp): Concord MCP is a freemium MCP server for developer tools.
- [note1](https://ai-powered.com/mcp/note1): note1 is an MCP server for productivity.
- [ASTra](https://ai-powered.com/mcp/astra): ASTra is a freemium MCP server for files and documents.
- [CalderFlow](https://ai-powered.com/mcp/calderflow): CalderFlow is a free MCP server for design and media.
- [CARTESIAN ECU](https://ai-powered.com/mcp/cartesian-ecu): CARTESIAN ECU is a paid MCP server for files and documents.
- [nicemails](https://ai-powered.com/mcp/nicemails): nicemails is a freemium MCP server for communication.
- [Invoices](https://ai-powered.com/mcp/invoices): Invoices is a paid MCP server for files and documents.

---
Source: https://ai-powered.com/mcp/removeduplicates-org
