RemoveDuplicates.org
Remove duplicate lines or CSV and TSV rows from text, processed per call and never stored
- Pricing
- Open source
- Platforms
- API, Web
- Runs
- Remotely
- Version
- 1.0.1
- Listing updated
- 1 day ago
About RemoveDuplicates.org
RemoveDuplicates.org is an open-source MCP server for files and documents. It runs as a hosted remote server, so there is nothing to install locally.
This hosted server exposes the same deduplication engine as the RemoveDuplicates.org site through one read-only tool, remove_duplicates. It takes up to 128 KiB of text and returns the cleaned text with counts. Options include format (auto, lines or table), ignoreCase, trim, removeEmpty, which copy to keep (first or last), whether to preserve order or sort, which column or columns to compare (or the whole row), and whether the first row is a header.
Each call is processed in memory and nothing is stored. The MCP endpoint is the only part of the project that handles content on a server; the website itself works in browser memory and uploads nothing, and the README says there are no accounts, analytics scripts or advertising pixels. Excel workbooks are handled by a separate browser-only page that accepts macro-free .xlsx files, because the MCP tool takes pasted text rather than workbooks.
No key or install is needed. The README gives setup lines for Claude Code, Cline, Cursor, VS Code and Gemini CLI, and suggests npx mcp-remote for stdio-only clients. The project is MIT licensed and runs as a Cloudflare Worker.
Install
Run in a terminal
claude mcp add --transport http remove-duplicates https://removeduplicates.org/mcpAdd to Settings → Connectors → Add custom connector
https://removeduplicates.org/mcpAdd to ~/.cursor/mcp.json
{
"mcpServers": {
"remove-duplicates": {
"url": "https://removeduplicates.org/mcp"
}
}
}Add to .vscode/mcp.json
{
"servers": {
"remove-duplicates": {
"type": "http",
"url": "https://removeduplicates.org/mcp"
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"remove-duplicates": {
"serverUrl": "https://removeduplicates.org/mcp"
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"remove-duplicates": {
"type": "http",
"url": "https://removeduplicates.org/mcp"
}
}
}Tools this server provides (1)
Taken from the project documentation; the running server may differ.
- remove_duplicates
- Remove duplicate lines or table rows from text and return cleaned text with counts
What it does
- Line deduplication
- Removes repeated lines, keeping first or last copy.
- Table-aware mode
- Compares whole CSV or TSV rows or chosen columns.
- Matching rules
- Case-insensitive matching, trimming and empty-line removal.
- Order control
- Preserve original order or sort unique lines.
- Stateless processing
- Each call is handled in memory and nothing is stored.
- No account
- No key, sign-in or install needed for the hosted endpoint.
Good for
- Clean a pasted list of URLs or names
- Dedupe a CSV by one column
- Remove repeated log lines
- Tidy a copied spreadsheet range before importing it
Pricing
Open source
MIT licence; free, no key
Prices change. Check removeduplicates.org before you buy.
RemoveDuplicates.org FAQ
What is the size limit?
The tool accepts up to 128 KiB of text per call.
Is my text stored?
No. The server processes it in memory per call and stores nothing.
Can it process Excel files?
Not through MCP. A separate browser-only Excel tool handles .xlsx files.
What licence is it?
MIT.
Is RemoveDuplicates.org free?
Yes. RemoveDuplicates.org is open source, so you can use and self-host it for free.
How do I add RemoveDuplicates.org to Claude Code?
Run this command in your terminal: claude mcp add --transport http remove-duplicates https://removeduplicates.org/mcp
What are the best alternatives to RemoveDuplicates.org?
The closest alternatives to RemoveDuplicates.org are Ha MCP, Concord MCP, note1, ASTra and CalderFlow.
Alternatives to RemoveDuplicates.org

Ha MCP
MCP serverMCP server for managing and automating Home Assistant from AI assistants
Runs locally- 8 tools
- Open source
- 7.9K GitHub stars
- Productivity

Concord MCP
MCP serverLocal-first MCP server for messaging and shared work-state between coding agents
Runs locally- Freemium
- 1.3K GitHub stars
- Developer tools

note1
MCP serverMCP server giving AI assistants search and summaries across your note1 meetings
- 4 tools
- Remote
- Free trial
- 1 GitHub star
- Productivity

ASTra
MCP serverLet agents read, edit, validate and undo Word .docx files with exact operations
Runs locally- 5 tools
- Freemium
- Files and documents

CalderFlow
MCP serverTurn notes or specs into editable flowcharts, timelines and funnels from an AI assistant
- 10 tools
- Remote
- Free
- Design and media

CARTESIAN ECU
MCP serverCheck and repair ECU and TCU flash-file checksums from Claude (Ultimate plan)
Not checked yet- 5 tools
- Remote
- Paid
- Files and documents