# Atesen Web and Developer Data

> Atesen Web and Developer Data is an open-source MCP server for web search and scraping. MCP server giving AI clients web, domain, feed, app store and model data via Apify. It runs as a hosted remote server, so there is nothing to install locally.

- **Kind:** MCP server
- **Pricing:** Open source
- **Platforms:** API, CLI, Web
- **Website:** https://atesensoftware.com
- **Repository:** https://github.com/pabsamuel/atesen-mcp/tree/HEAD/servers/web-data
- **MCP Registry name:** io.github.pabsamuel/atesen-web-data-mcp
- **Categories:** [web search and scraping](https://ai-powered.com/categories/web-search-and-scraping)
- **Listing updated:** 2026-11-20

## About

The README describes this as a Model Context Protocol server that wraps twelve public Apify Actors from the atesen-software account. Each tool call runs on the user's own Apify account with their token, so usage is billed per result by Apify at the Actor's listed price, and the server itself stores and logs nothing.

The tools cover web extraction and analysis: converting pages, PDFs and sitemaps to Markdown or text chunks, detecting site technologies, looking up WHOIS/RDAP registration data, and crawling sites for SEO metadata and broken links. Other tools read RSS and Atom feeds, search Hacker News, pull Hugging Face model metadata, retrieve App Store and Google Play reviews and details, and read Shopify store products.

The server is aimed at developers and analysts who want an AI assistant to pull live public web data. The README suggests starting with a small result limit and setting a per-call charge cap through an environment variable.

## Features

- **Markdown conversion for retrieval:** Turns web pages, PDFs and sitemaps into Markdown, or into text chunks for retrieval workflows.
- **Domain and tech lookups:** Returns RDAP registration details and detects technologies used by public websites.
- **SEO and link auditing:** Crawls websites to inspect SEO metadata and find broken links.
- **Feeds and Hacker News:** Reads RSS, Atom, RDF and JSON feeds and searches Hacker News stories and comments.
- **App store and model data:** Retrieves App Store and Google Play reviews and app details, plus Hugging Face model metadata.
- **Per-call spending cap:** An environment variable limits what a single tool call may cost on the user's Apify account.

## Good for

- Feed web page content into a retrieval pipeline as Markdown or chunks
- Check a domain's registrar, expiry and DNS metadata from an AI assistant
- Audit a site's SEO metadata and broken links
- Monitor RSS feeds and Hacker News discussions for a topic
- Compare app store ratings and reviews across Apple and Google Play
- Look up Hugging Face model licenses and download counts

## Install

### Claude Code (Terminal)

```sh
claude mcp add --transport http atesen-web-data-mcp 'https://mcp.apify.com?tools=atesen-software/url-to-markdown-rag,atesen-software/llm-dataset-builder,atesen-software/website-tech-stack-detector,atesen-software/domain-whois-rdap-lookup,atesen-software/website-seo-audit,atesen-software/rss-feed-reader,atesen-software/hacker-news-search-comments,atesen-software/huggingface-model-intel,atesen-software/app-store-scraper,atesen-software/app-store-reviews-scraper,atesen-software/google-play-reviews-scraper,atesen-software/shopify-store-products-scraper'
```

### Claude Desktop (Settings → Connectors → Add custom connector)

```sh
https://mcp.apify.com?tools=atesen-software/url-to-markdown-rag,atesen-software/llm-dataset-builder,atesen-software/website-tech-stack-detector,atesen-software/domain-whois-rdap-lookup,atesen-software/website-seo-audit,atesen-software/rss-feed-reader,atesen-software/hacker-news-search-comments,atesen-software/huggingface-model-intel,atesen-software/app-store-scraper,atesen-software/app-store-reviews-scraper,atesen-software/google-play-reviews-scraper,atesen-software/shopify-store-products-scraper
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "atesen-web-data-mcp": {
      "url": "https://mcp.apify.com?tools=atesen-software/url-to-markdown-rag,atesen-software/llm-dataset-builder,atesen-software/website-tech-stack-detector,atesen-software/domain-whois-rdap-lookup,atesen-software/website-seo-audit,atesen-software/rss-feed-reader,atesen-software/hacker-news-search-comments,atesen-software/huggingface-model-intel,atesen-software/app-store-scraper,atesen-software/app-store-reviews-scraper,atesen-software/google-play-reviews-scraper,atesen-software/shopify-store-products-scraper"
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "atesen-web-data-mcp": {
      "type": "http",
      "url": "https://mcp.apify.com?tools=atesen-software/url-to-markdown-rag,atesen-software/llm-dataset-builder,atesen-software/website-tech-stack-detector,atesen-software/domain-whois-rdap-lookup,atesen-software/website-seo-audit,atesen-software/rss-feed-reader,atesen-software/hacker-news-search-comments,atesen-software/huggingface-model-intel,atesen-software/app-store-scraper,atesen-software/app-store-reviews-scraper,atesen-software/google-play-reviews-scraper,atesen-software/shopify-store-products-scraper"
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "atesen-web-data-mcp": {
      "serverUrl": "https://mcp.apify.com?tools=atesen-software/url-to-markdown-rag,atesen-software/llm-dataset-builder,atesen-software/website-tech-stack-detector,atesen-software/domain-whois-rdap-lookup,atesen-software/website-seo-audit,atesen-software/rss-feed-reader,atesen-software/hacker-news-search-comments,atesen-software/huggingface-model-intel,atesen-software/app-store-scraper,atesen-software/app-store-reviews-scraper,atesen-software/google-play-reviews-scraper,atesen-software/shopify-store-products-scraper"
    }
  }
}
```

### Grok Bot (Grok Bot desktop app → Connect apps → Add a custom connector)

```sh
https://mcp.apify.com?tools=atesen-software/url-to-markdown-rag,atesen-software/llm-dataset-builder,atesen-software/website-tech-stack-detector,atesen-software/domain-whois-rdap-lookup,atesen-software/website-seo-audit,atesen-software/rss-feed-reader,atesen-software/hacker-news-search-comments,atesen-software/huggingface-model-intel,atesen-software/app-store-scraper,atesen-software/app-store-reviews-scraper,atesen-software/google-play-reviews-scraper,atesen-software/shopify-store-products-scraper
```

Enter a Name (for example "Atesen Web and Developer Data"), choose Type: Remote HTTPS, paste this as the Server URL and choose Add plugin. When we checked, this server asked for a bearer token. Add it under HTTP headers as Authorization: Bearer <your token>.

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "atesen-web-data-mcp": {
      "type": "http",
      "url": "https://mcp.apify.com?tools=atesen-software/url-to-markdown-rag,atesen-software/llm-dataset-builder,atesen-software/website-tech-stack-detector,atesen-software/domain-whois-rdap-lookup,atesen-software/website-seo-audit,atesen-software/rss-feed-reader,atesen-software/hacker-news-search-comments,atesen-software/huggingface-model-intel,atesen-software/app-store-scraper,atesen-software/app-store-reviews-scraper,atesen-software/google-play-reviews-scraper,atesen-software/shopify-store-products-scraper"
    }
  }
}
```

## Tools

- `url_to_markdown_rag`: Convert web pages, PDFs and sitemaps to Markdown for retrieval workflows.
- `llm_dataset_builder`: Convert website content to Markdown and text chunks for retrieval workflows.
- `website_tech_stack_detector`: Identify technologies used by public websites.
- `domain_whois_rdap_lookup`: Look up domain registration, expiry, registrar and DNS metadata.
- `website_seo_audit`: Crawl websites to inspect SEO metadata and broken links.
- `rss_feed_reader`: Read public RSS, Atom, RDF and JSON feeds.
- `hacker_news_search_comments`: Search public Hacker News stories and comments or read the front page.
- `huggingface_model_intel`: Retrieve public model metadata, licenses, download counts and likes.
- `app_store_scraper`: Retrieve public Apple App Store app details, ratings, prices and versions.
- `app_store_reviews_scraper`: Retrieve public App Store reviews and ratings by country.
- `google_play_reviews_scraper`: Retrieve public Google Play app reviews and ratings.
- `shopify_store_products_scraper`: Retrieve products, prices, variants and stock from Shopify stores.

## FAQ

### Who pays for the data requests?

The README says each run happens on the user's own Apify account with their own token, and Apify bills per result at the Actor's published pay-per-event price.

### Does the server store any data?

The README says the server has no backend of its own, stores nothing and logs nothing.

### How do I limit what a call can cost?

Set the ATESEN_MAX_CHARGE_USD environment variable, which is passed to Apify as maxTotalChargeUsd. ATESEN_TIMEOUT_SECS bounds how long a call waits.

### Which transport does Atesen Web and Developer Data use?

The registry entry lists streamable-http as the transport, and the README gives an npx install command for desktop clients such as Claude Desktop, Cursor and VS Code.

### How do I add Atesen Web and Developer Data to Claude Code?

Run this command in your terminal: claude mcp add --transport http atesen-web-data-mcp 'https://mcp.apify.com?tools=atesen-software/url-to-markdown-rag,atesen-software/llm-dataset-builder,atesen-software/website-tech-stack-detector,atesen-software/domain-whois-rdap-lookup,atesen-software/website-seo-audit,atesen-software/rss-feed-reader,atesen-software/hacker-news-search-comments,atesen-software/huggingface-model-intel,atesen-software/app-store-scraper,atesen-software/app-store-reviews-scraper,atesen-software/google-play-reviews-scraper,atesen-software/shopify-store-products-scraper'

### What are the best alternatives to Atesen Web and Developer Data?

The closest alternatives to Atesen Web and Developer Data are fecklesspleb Apify Actors, AutomationNation Data Tools, Web & Developer Data Tools, Atesen Company and Jobs Data and Honestkit MCP.

## Where this comes from

- Description: written from the project's README, the project's website and its MCP Registry entry.
- Status: checked automatically by AIPoweredBot on 21 November 2026.
- Install steps: from the official MCP Registry entry.

## Alternatives

- [fecklesspleb Apify Actors](https://ai-powered.com/mcp/fecklesspleb-apify-actors): fecklesspleb Apify Actors is a paid MCP server for web search and scraping.
- [AutomationNation Data Tools](https://ai-powered.com/mcp/automationnation-data-tools): AutomationNation Data Tools is a paid MCP server for maps and travel.
- [Web & Developer Data Tools](https://ai-powered.com/mcp/web-and-developer-data-tools): Web & Developer Data Tools is a freemium MCP server for developer tools.
- [Atesen Company and Jobs Data](https://ai-powered.com/mcp/atesen-company-and-jobs-data): Atesen Company and Jobs Data is an open-source MCP server for company data.
- [Honestkit MCP](https://ai-powered.com/mcp/honestkit-mcp): Honestkit MCP is an open-source MCP server for web search and scraping.
- [Pandapi: web, PDF, reviews & tenders data tools](https://ai-powered.com/mcp/pandapi-web-pdf-reviews-and-tenders-data-tools): Pandapi: web, PDF, reviews & tenders data tools is a freemium MCP server for web search and scraping.
- [Panda Federation Tools](https://ai-powered.com/mcp/panda-federation-tools): Panda Federation Tools is an open-source MCP server for web search and scraping.
- [Website RAG Markdown Crawler & Contact Finder MCP](https://ai-powered.com/mcp/website-rag-markdown-crawler-and-contact-finder-mcp): Website RAG Markdown Crawler & Contact Finder MCP is a freemium MCP server for web search and scraping.

---
Source: https://ai-powered.com/mcp/atesen-web-and-developer-data
