Merge & Deduplicate Datasets (Ctrio Lab)
Merges Apify datasets and removes duplicates by one or more fields
- Pricing
- Paid
- Platforms
- API, Web
- Runs
- Remotely
- Version
- 0.1.0
- Listing updated
- 2 days ago
About Merge & Deduplicate Datasets (Ctrio Lab)
Merge & Deduplicate Datasets (Ctrio Lab) is a paid MCP server for analytics and data. It runs as a hosted remote server, so there is nothing to install locally.
The point of this Actor is to join many scraper runs, for example 30 daily runs of one scraper, into a single clean dataset in the order you list them. Duplicates are defined by one or more fields, including nested dot paths like address.city, and you choose whether to keep the first or the last copy.
Items are streamed page by page so memory stays flat; the author reports a 105,000-item merge peaking at 125 MB. Comparison trims, collapses spaces and lowercases by default, objects are compared by content, and items missing the dedupe fields are never treated as duplicates. You can also keep and rename output fields, and a SUMMARY record counts items read, unique items and duplicates removed.
It runs with read-only permission on source datasets and does not support custom JavaScript transforms. Cost is $0.05 per 1,000 items written; reads and removed duplicates are free.
Install
Run in a terminal
claude mcp add --transport http merge-dedupe-datasets 'https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets'Add to Settings → Connectors → Add custom connector
https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasetsAdd to ~/.cursor/mcp.json
{
"mcpServers": {
"merge-dedupe-datasets": {
"url": "https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets"
}
}
}Add to .vscode/mcp.json
{
"servers": {
"merge-dedupe-datasets": {
"type": "http",
"url": "https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets"
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"merge-dedupe-datasets": {
"serverUrl": "https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets"
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"merge-dedupe-datasets": {
"type": "http",
"url": "https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets"
}
}
}What it does
- Multi-dataset merge
- Combines any number of datasets in the listed order.
- Field-based dedupe
- Uses one or more fields, including dot paths.
- Keep first or last
- Chooses which duplicate survives.
- Field shaping
- Keeps and renames output fields.
- Low memory streaming
- Reads page by page to handle large datasets.
- Run summary
- Counts reads, uniques and removed duplicates.
Good for
- Combine daily scraper runs into one dataset
- Remove repeated listings by URL
- Keep the newest copy of each record
- Reshape fields before exporting to CSV
Pricing
Paid
$0.05 per 1,000 items written plus a small start fee
Prices change. Check apify.com before you buy.
Merge & Deduplicate Datasets (Ctrio Lab) FAQ
Does it change my source datasets?
No. It only reads them and writes to its own run dataset.
How much does it cost?
$0.05 per 1,000 items written, plus a small start fee.
Can I run custom code on items?
No; use the fields and rename options.
How do I pass datasets?
As dataset IDs, since it cannot list your runs itself.
Is Merge & Deduplicate Datasets (Ctrio Lab) free?
No. Merge & Deduplicate Datasets (Ctrio Lab) is a paid product.
How do I add Merge & Deduplicate Datasets (Ctrio Lab) to Claude Code?
Run this command in your terminal: claude mcp add --transport http merge-dedupe-datasets 'https://mcp.apify.com?tools=ctriolab/merge-dedupe-datasets'
What are the best alternatives to Merge & Deduplicate Datasets (Ctrio Lab)?
The closest alternatives to Merge & Deduplicate Datasets (Ctrio Lab) are Agent-Native Analytics, Google Ads + Meta Ads + SEO/GEO MCP, Tapetide - Indian Stock Market MCP, World Monitor and CompanyData.
Alternatives to Merge & Deduplicate Datasets (Ctrio Lab)

Agent-Native Analytics
MCP serverOpen-source analytics app where an AI agent builds charts and dashboards from your data
- Remote
- Open source
- 7.7K GitHub stars
- Analytics and data

Google Ads + Meta Ads + SEO/GEO MCP
MCP serverHosted MCP connector for managing Google Ads, Meta Ads, GA4 and Search Console from chat
- 8 tools
- Remote
- Freemium
- 8.1K GitHub stars
- Marketing and SEO

Tapetide - Indian Stock Market MCP
MCP serverIndian NSE and BSE stock market data for AI assistants through 48 MCP tools
- 17 tools
- Remote
- Freemium
- 150 GitHub stars
- Finance and payments

World Monitor
MCP serverLive geopolitical intelligence dashboard with an API and MCP server for agents
- Remote
- Freemium
- Analytics and data

CompanyData
MCP serverSearch and enrich company records from official registers via the CompanyData API
- 3 tools
- Remote
- Paid
- 3 GitHub stars
- Analytics and data

ChartAnt
MCP serverRemote MCP server returning charts, maps and dashboards as hosted PNG links
- 51 tools
- Remote
- Freemium
- Design and media