Skip to content
MCP server

Atesen Web and Developer Data

MCP server giving AI clients web, domain, feed, app store and model data via Apify

Answers · sign-in required (bearer token)

The server answered 7 hours ago with a sign-in request for a bearer token (HTTP 401), so we could not list its tools.

Install

Atesen Web and Developer Data is an open-source MCP server for web search and scraping. It runs as a hosted remote server, so there is nothing to install locally.

Pricing
Open source
Platforms
API, CLI, Web
Runs
Remotely
Access
Needs sign-in (bearer token)
Version
0.1.0
Listing updated

Similar MCP servers

Install

Run in a terminal

claude mcp add --transport http atesen-web-data-mcp 'https://mcp.apify.com?tools=atesen-software/url-to-markdown-rag,atesen-software/llm-dataset-builder,atesen-software/website-tech-stack-detector,atesen-software/domain-whois-rdap-lookup,atesen-software/website-seo-audit,atesen-software/rss-feed-reader,atesen-software/hacker-news-search-comments,atesen-software/huggingface-model-intel,atesen-software/app-store-scraper,atesen-software/app-store-reviews-scraper,atesen-software/google-play-reviews-scraper,atesen-software/shopify-store-products-scraper'

Add to Settings → Connectors → Add custom connector

https://mcp.apify.com?tools=atesen-software/url-to-markdown-rag,atesen-software/llm-dataset-builder,atesen-software/website-tech-stack-detector,atesen-software/domain-whois-rdap-lookup,atesen-software/website-seo-audit,atesen-software/rss-feed-reader,atesen-software/hacker-news-search-comments,atesen-software/huggingface-model-intel,atesen-software/app-store-scraper,atesen-software/app-store-reviews-scraper,atesen-software/google-play-reviews-scraper,atesen-software/shopify-store-products-scraper
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "atesen-web-data-mcp": {
      "url": "https://mcp.apify.com?tools=atesen-software/url-to-markdown-rag,atesen-software/llm-dataset-builder,atesen-software/website-tech-stack-detector,atesen-software/domain-whois-rdap-lookup,atesen-software/website-seo-audit,atesen-software/rss-feed-reader,atesen-software/hacker-news-search-comments,atesen-software/huggingface-model-intel,atesen-software/app-store-scraper,atesen-software/app-store-reviews-scraper,atesen-software/google-play-reviews-scraper,atesen-software/shopify-store-products-scraper"
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "atesen-web-data-mcp": {
      "type": "http",
      "url": "https://mcp.apify.com?tools=atesen-software/url-to-markdown-rag,atesen-software/llm-dataset-builder,atesen-software/website-tech-stack-detector,atesen-software/domain-whois-rdap-lookup,atesen-software/website-seo-audit,atesen-software/rss-feed-reader,atesen-software/hacker-news-search-comments,atesen-software/huggingface-model-intel,atesen-software/app-store-scraper,atesen-software/app-store-reviews-scraper,atesen-software/google-play-reviews-scraper,atesen-software/shopify-store-products-scraper"
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "atesen-web-data-mcp": {
      "serverUrl": "https://mcp.apify.com?tools=atesen-software/url-to-markdown-rag,atesen-software/llm-dataset-builder,atesen-software/website-tech-stack-detector,atesen-software/domain-whois-rdap-lookup,atesen-software/website-seo-audit,atesen-software/rss-feed-reader,atesen-software/hacker-news-search-comments,atesen-software/huggingface-model-intel,atesen-software/app-store-scraper,atesen-software/app-store-reviews-scraper,atesen-software/google-play-reviews-scraper,atesen-software/shopify-store-products-scraper"
    }
  }
}

Add to Grok Bot desktop app → Connect apps → Add a custom connector

https://mcp.apify.com?tools=atesen-software/url-to-markdown-rag,atesen-software/llm-dataset-builder,atesen-software/website-tech-stack-detector,atesen-software/domain-whois-rdap-lookup,atesen-software/website-seo-audit,atesen-software/rss-feed-reader,atesen-software/hacker-news-search-comments,atesen-software/huggingface-model-intel,atesen-software/app-store-scraper,atesen-software/app-store-reviews-scraper,atesen-software/google-play-reviews-scraper,atesen-software/shopify-store-products-scraper

Enter a Name (for example "Atesen Web and Developer Data"), choose Type: Remote HTTPS, paste this as the Server URL and choose Add plugin. When we checked, this server asked for a bearer token. Add it under HTTP headers as Authorization: Bearer <your token>.

Full Grok Bot setup guide

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "atesen-web-data-mcp": {
      "type": "http",
      "url": "https://mcp.apify.com?tools=atesen-software/url-to-markdown-rag,atesen-software/llm-dataset-builder,atesen-software/website-tech-stack-detector,atesen-software/domain-whois-rdap-lookup,atesen-software/website-seo-audit,atesen-software/rss-feed-reader,atesen-software/hacker-news-search-comments,atesen-software/huggingface-model-intel,atesen-software/app-store-scraper,atesen-software/app-store-reviews-scraper,atesen-software/google-play-reviews-scraper,atesen-software/shopify-store-products-scraper"
    }
  }
}

Using several servers? Build one config file with the MCP config generator.

About Atesen Web and Developer Data

The README describes this as a Model Context Protocol server that wraps twelve public Apify Actors from the atesen-software account. Each tool call runs on the user's own Apify account with their token, so usage is billed per result by Apify at the Actor's listed price, and the server itself stores and logs nothing.

The tools cover web extraction and analysis: converting pages, PDFs and sitemaps to Markdown or text chunks, detecting site technologies, looking up WHOIS/RDAP registration data, and crawling sites for SEO metadata and broken links. Other tools read RSS and Atom feeds, search Hacker News, pull Hugging Face model metadata, retrieve App Store and Google Play reviews and details, and read Shopify store products.

The server is aimed at developers and analysts who want an AI assistant to pull live public web data. The README suggests starting with a small result limit and setting a per-call charge cap through an environment variable.

Tools this server provides (12)

Taken from the project documentation; the running server may differ.

url_to_markdown_rag
Convert web pages, PDFs and sitemaps to Markdown for retrieval workflows.
llm_dataset_builder
Convert website content to Markdown and text chunks for retrieval workflows.
website_tech_stack_detector
Identify technologies used by public websites.
domain_whois_rdap_lookup
Look up domain registration, expiry, registrar and DNS metadata.
website_seo_audit
Crawl websites to inspect SEO metadata and broken links.
rss_feed_reader
Read public RSS, Atom, RDF and JSON feeds.
hacker_news_search_comments
Search public Hacker News stories and comments or read the front page.
huggingface_model_intel
Retrieve public model metadata, licenses, download counts and likes.
app_store_scraper
Retrieve public Apple App Store app details, ratings, prices and versions.
app_store_reviews_scraper
Retrieve public App Store reviews and ratings by country.
google_play_reviews_scraper
Retrieve public Google Play app reviews and ratings.
shopify_store_products_scraper
Retrieve products, prices, variants and stock from Shopify stores.

What it does

Markdown conversion for retrieval
Turns web pages, PDFs and sitemaps into Markdown, or into text chunks for retrieval workflows.
Domain and tech lookups
Returns RDAP registration details and detects technologies used by public websites.
SEO and link auditing
Crawls websites to inspect SEO metadata and find broken links.
Feeds and Hacker News
Reads RSS, Atom, RDF and JSON feeds and searches Hacker News stories and comments.
App store and model data
Retrieves App Store and Google Play reviews and app details, plus Hugging Face model metadata.
Per-call spending cap
An environment variable limits what a single tool call may cost on the user's Apify account.

Good for

  • Feed web page content into a retrieval pipeline as Markdown or chunks
  • Check a domain's registrar, expiry and DNS metadata from an AI assistant
  • Audit a site's SEO metadata and broken links
  • Monitor RSS feeds and Hacker News discussions for a topic
  • Compare app store ratings and reviews across Apple and Google Play
  • Look up Hugging Face model licenses and download counts

Pricing

Open source

MIT-licensed server; Apify charges per result, up to $0.0015 per result for most tools.

Prices change. Check atesensoftware.com before you buy.

Atesen Web and Developer Data FAQ

Who pays for the data requests?

The README says each run happens on the user's own Apify account with their own token, and Apify bills per result at the Actor's published pay-per-event price.

Does the server store any data?

The README says the server has no backend of its own, stores nothing and logs nothing.

How do I limit what a call can cost?

Set the ATESEN_MAX_CHARGE_USD environment variable, which is passed to Apify as maxTotalChargeUsd. ATESEN_TIMEOUT_SECS bounds how long a call waits.

Which transport does Atesen Web and Developer Data use?

The registry entry lists streamable-http as the transport, and the README gives an npx install command for desktop clients such as Claude Desktop, Cursor and VS Code.

How do I add Atesen Web and Developer Data to Claude Code?

Run this command in your terminal: claude mcp add --transport http atesen-web-data-mcp 'https://mcp.apify.com?tools=atesen-software/url-to-markdown-rag,atesen-software/llm-dataset-builder,atesen-software/website-tech-stack-detector,atesen-software/domain-whois-rdap-lookup,atesen-software/website-seo-audit,atesen-software/rss-feed-reader,atesen-software/hacker-news-search-comments,atesen-software/huggingface-model-intel,atesen-software/app-store-scraper,atesen-software/app-store-reviews-scraper,atesen-software/google-play-reviews-scraper,atesen-software/shopify-store-products-scraper'

What are the best alternatives to Atesen Web and Developer Data?

The closest alternatives to Atesen Web and Developer Data are fecklesspleb Apify Actors, AutomationNation Data Tools, Web & Developer Data Tools, Atesen Company and Jobs Data and Honestkit MCP.

Where this comes from

  • Description: written from the project's README, the project's website and its MCP Registry entry.
  • Status: checked automatically by AIPoweredBot on 21 November 2026.
  • Install steps: from the official MCP Registry entry.

How AIPoweredBot checks servers