Skip to content
MCP server

Merge & Deduplicate Datasets (Ctrio Lab)

Merges Apify datasets and removes duplicates by one or more fields

Install
Pricing
Paid
Platforms
API, Web
Runs
Remotely
Version
0.1.0
Listing updated
2 days ago

About Merge & Deduplicate Datasets (Ctrio Lab)

Merge & Deduplicate Datasets (Ctrio Lab) is a paid MCP server for analytics and data. It runs as a hosted remote server, so there is nothing to install locally.

The point of this Actor is to join many scraper runs, for example 30 daily runs of one scraper, into a single clean dataset in the order you list them. Duplicates are defined by one or more fields, including nested dot paths like address.city, and you choose whether to keep the first or the last copy.

Items are streamed page by page so memory stays flat; the author reports a 105,000-item merge peaking at 125 MB. Comparison trims, collapses spaces and lowercases by default, objects are compared by content, and items missing the dedupe fields are never treated as duplicates. You can also keep and rename output fields, and a SUMMARY record counts items read, unique items and duplicates removed.

It runs with read-only permission on source datasets and does not support custom JavaScript transforms. Cost is $0.05 per 1,000 items written; reads and removed duplicates are free.

Install

Run in a terminal

claude mcp add --transport http merge-dedupe-datasets 'https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets'

Add to Settings → Connectors → Add custom connector

https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "merge-dedupe-datasets": {
      "url": "https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets"
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "merge-dedupe-datasets": {
      "type": "http",
      "url": "https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets"
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "merge-dedupe-datasets": {
      "serverUrl": "https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets"
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "merge-dedupe-datasets": {
      "type": "http",
      "url": "https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets"
    }
  }
}

What it does

Multi-dataset merge
Combines any number of datasets in the listed order.
Field-based dedupe
Uses one or more fields, including dot paths.
Keep first or last
Chooses which duplicate survives.
Field shaping
Keeps and renames output fields.
Low memory streaming
Reads page by page to handle large datasets.
Run summary
Counts reads, uniques and removed duplicates.

Good for

  • Combine daily scraper runs into one dataset
  • Remove repeated listings by URL
  • Keep the newest copy of each record
  • Reshape fields before exporting to CSV

Pricing

Paid

$0.05 per 1,000 items written plus a small start fee

Prices change. Check apify.com before you buy.

Merge & Deduplicate Datasets (Ctrio Lab) FAQ

Does it change my source datasets?

No. It only reads them and writes to its own run dataset.

How much does it cost?

$0.05 per 1,000 items written, plus a small start fee.

Can I run custom code on items?

No; use the fields and rename options.

How do I pass datasets?

As dataset IDs, since it cannot list your runs itself.

Is Merge & Deduplicate Datasets (Ctrio Lab) free?

No. Merge & Deduplicate Datasets (Ctrio Lab) is a paid product.

How do I add Merge & Deduplicate Datasets (Ctrio Lab) to Claude Code?

Run this command in your terminal: claude mcp add --transport http merge-dedupe-datasets 'https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets'

What are the best alternatives to Merge & Deduplicate Datasets (Ctrio Lab)?

The closest alternatives to Merge & Deduplicate Datasets (Ctrio Lab) are Agent-Native Analytics, Google Ads + Meta Ads + SEO/GEO MCP, Tapetide - Indian Stock Market MCP, World Monitor and CompanyData.

Alternatives to Merge & Deduplicate Datasets (Ctrio Lab)

  1. Open-source analytics app where an AI agent builds charts and dashboards from your data

    • Remote
    • Open source
    • 7.7K GitHub stars
    • Analytics and data
  2. Hosted MCP connector for managing Google Ads, Meta Ads, GA4 and Search Console from chat

    • 8 tools
    • Remote
    • Freemium
    • 8.1K GitHub stars
    • Marketing and SEO
  3. Indian NSE and BSE stock market data for AI assistants through 48 MCP tools

    • 17 tools
    • Remote
    • Freemium
    • 150 GitHub stars
    • Finance and payments
  4. World Monitor

    MCP server

    Live geopolitical intelligence dashboard with an API and MCP server for agents

    • Remote
    • Freemium
    • Analytics and data
  5. CompanyData

    MCP server

    Search and enrich company records from official registers via the CompanyData API

    • 3 tools
    • Remote
    • Paid
    • 3 GitHub stars
    • Analytics and data
  6. ChartAnt

    MCP server

    Remote MCP server returning charts, maps and dashboards as hosted PNG links

    • 51 tools
    • Remote
    • Freemium
    • Design and media