# Merge & Deduplicate Datasets (Ctrio Lab)

> Merge & Deduplicate Datasets (Ctrio Lab) is a paid MCP server for analytics and data. Merges Apify datasets and removes duplicates by one or more fields. It runs as a hosted remote server, so there is nothing to install locally.

- **Kind:** MCP server
- **Pricing:** Paid
- **Platforms:** API, Web
- **Website:** https://apify.com/ctriolab/merge-dedupe-datasets
- **MCP Registry name:** com.ctriolab/merge-dedupe-datasets
- **Categories:** analytics and data
- **Listing updated:** 2026-11-15

## About

The point of this Actor is to join many scraper runs, for example 30 daily runs of one scraper, into a single clean dataset in the order you list them. Duplicates are defined by one or more fields, including nested dot paths like address.city, and you choose whether to keep the first or the last copy.

Items are streamed page by page so memory stays flat; the author reports a 105,000-item merge peaking at 125 MB. Comparison trims, collapses spaces and lowercases by default, objects are compared by content, and items missing the dedupe fields are never treated as duplicates. You can also keep and rename output fields, and a SUMMARY record counts items read, unique items and duplicates removed.

It runs with read-only permission on source datasets and does not support custom JavaScript transforms. Cost is $0.05 per 1,000 items written; reads and removed duplicates are free.

## Features

- **Multi-dataset merge:** Combines any number of datasets in the listed order.
- **Field-based dedupe:** Uses one or more fields, including dot paths.
- **Keep first or last:** Chooses which duplicate survives.
- **Field shaping:** Keeps and renames output fields.
- **Low memory streaming:** Reads page by page to handle large datasets.
- **Run summary:** Counts reads, uniques and removed duplicates.

## Good for

- Combine daily scraper runs into one dataset
- Remove repeated listings by URL
- Keep the newest copy of each record
- Reshape fields before exporting to CSV

## Install

### Claude Code (Terminal)

```sh
claude mcp add --transport http merge-dedupe-datasets 'https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets'
```

### Claude Desktop (Settings → Connectors → Add custom connector)

```sh
https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "merge-dedupe-datasets": {
      "url": "https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets"
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "merge-dedupe-datasets": {
      "type": "http",
      "url": "https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets"
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "merge-dedupe-datasets": {
      "serverUrl": "https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets"
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "merge-dedupe-datasets": {
      "type": "http",
      "url": "https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets"
    }
  }
}
```

## FAQ

### Does it change my source datasets?

No. It only reads them and writes to its own run dataset.

### How much does it cost?

$0.05 per 1,000 items written, plus a small start fee.

### Can I run custom code on items?

No; use the fields and rename options.

### How do I pass datasets?

As dataset IDs, since it cannot list your runs itself.

### Is Merge & Deduplicate Datasets (Ctrio Lab) free?

No. Merge & Deduplicate Datasets (Ctrio Lab) is a paid product.

### How do I add Merge & Deduplicate Datasets (Ctrio Lab) to Claude Code?

Run this command in your terminal: claude mcp add --transport http merge-dedupe-datasets 'https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets'

### What are the best alternatives to Merge & Deduplicate Datasets (Ctrio Lab)?

The closest alternatives to Merge & Deduplicate Datasets (Ctrio Lab) are Agent-Native Analytics, Google Ads + Meta Ads + SEO/GEO MCP, Tapetide - Indian Stock Market MCP, World Monitor and CompanyData.

## Alternatives

- [Agent-Native Analytics](https://ai-powered.com/mcp/agent-native-analytics): Agent-Native Analytics is an open-source MCP server for analytics and data.
- [Google Ads + Meta Ads + SEO/GEO MCP](https://ai-powered.com/mcp/google-ads-meta-ads-seo-geo-mcp): Google Ads + Meta Ads + SEO/GEO MCP is a freemium MCP server for marketing and seo.
- [Tapetide - Indian Stock Market MCP](https://ai-powered.com/mcp/tapetide-indian-stock-market-mcp): Tapetide - Indian Stock Market MCP is a freemium MCP server for finance and payments.
- [World Monitor](https://ai-powered.com/mcp/world-monitor): World Monitor is a freemium MCP server for analytics and data.
- [CompanyData](https://ai-powered.com/mcp/companydata): CompanyData is a paid MCP server for analytics and data.
- [ChartAnt](https://ai-powered.com/mcp/chartant): ChartAnt is a freemium MCP server for design and media.
- [Quantivex Research](https://ai-powered.com/mcp/quantivex-research): Quantivex Research is a free MCP server for finance and payments.
- [Provyan](https://ai-powered.com/mcp/provyan): Provyan is a free MCP server for finance and payments.

---
Source: https://ai-powered.com/mcp/merge-and-deduplicate-datasets-ctrio-lab
