# Website Tech Stack, SEO & llms.txt Check

> Website Tech Stack, SEO & llms.txt Check is a paid MCP server for marketing and seo. One-row-per-site audit of tech stack, SEO issues, AI-bot rules, sitemap and llms.txt. It runs as a hosted remote server, so there is nothing to install locally.

- **Kind:** MCP server
- **Pricing:** Paid
- **Platforms:** API, Web
- **Website:** https://apify.com/fairquery/website-tech-seo-ai-readiness
- **Repository:** https://github.com/fairquery/website-tech-seo-ai-readiness
- **MCP Registry name:** io.github.fairquery/website-tech-seo-ai-readiness
- **Categories:** marketing and SEO, AI models and LLM tooling, developer tools
- **Listing updated:** 2026-11-15

## About

Each site you pass in becomes a single structured row. It lists detected technologies by category, title and meta tags, Open Graph and JSON-LD types, security headers, an SEO issue list with a 0 to 100 score, a separate 0 to 100 AI-readiness score, and whether robots.txt allows, partly blocks or blocks GPTBot, ClaudeBot, PerplexityBot, Google-Extended and CCBot.

Checks use plain HTTP with no browser, about 75 signatures from HTML, headers, cookies and meta generators, so detection is heuristic and single-page apps that render client-side may show a thin-content flag. It only checks the page you give it plus robots.txt, the sitemap and llms.txt files, and it identifies itself as FairqueryBot and respects robots.txt by default.

It suits lead enrichment, quick homepage audits and agents answering questions such as whether a site serves llms.txt. It does not do full crawls, Core Web Vitals or backlink data.

## Features

- **Tech stack detection:** Reports CMS, framework, analytics, chat, payments, CDN and hosting.
- **SEO score:** Gives a 0 to 100 score with coded issues and severity.
- **AI crawler rules:** Maps robots.txt access for major AI bots as allowed, partial or blocked.
- **llms.txt check:** Looks for llms.txt and llms-full.txt and reads the title.
- **Sitemap count:** Finds the sitemap and counts its URLs.

## Good for

- Enrich a lead list with each company's website platform
- Check whether a site blocks GPTBot or ClaudeBot
- Spot-check landing pages for missing meta tags
- Score sites for AI-readiness before a content project

## Install

### Claude Code (Terminal)

```sh
claude mcp add --transport http website-tech-seo-ai-readiness 'https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness'
```

### Claude Desktop (Settings → Connectors → Add custom connector)

```sh
https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "website-tech-seo-ai-readiness": {
      "url": "https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness"
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "website-tech-seo-ai-readiness": {
      "type": "http",
      "url": "https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness"
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "website-tech-seo-ai-readiness": {
      "serverUrl": "https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness"
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "website-tech-seo-ai-readiness": {
      "type": "http",
      "url": "https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness"
    }
  }
}
```

## Tools

- `fairquery/website-tech-seo-ai-readiness`: Returns tech stack, SEO score, AI-bot rules, sitemap and llms.txt status for each site.
- `fetch-actor-details`: Fetches details of the Actor.

## FAQ

### Does it crawl the whole site?

No. It fetches the page you supply plus robots.txt, sitemap and llms.txt files.

### Does it run JavaScript?

No. It uses plain HTTP, so client-rendered apps may be flagged for thin content.

### How much does it cost?

$1.50 per 1,000 sites on the Free plan, down to $1.00 on Business; sites that cannot be fetched are not charged.

### How many sites fit in the free allowance?

Roughly 3,300 per month from the $5 of usage on Apify's Free plan.

### Is Website Tech Stack, SEO & llms.txt Check free?

No. Website Tech Stack, SEO & llms.txt Check is a paid product.

### How do I add Website Tech Stack, SEO & llms.txt Check to Claude Code?

Run this command in your terminal: claude mcp add --transport http website-tech-seo-ai-readiness 'https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness'

### What are the best alternatives to Website Tech Stack, SEO & llms.txt Check?

The closest alternatives to Website Tech Stack, SEO & llms.txt Check are REA, Codebase Memory, GitHub, Serena MCP: the IDE for your agent and XERJ.

## Alternatives

- [REA](https://ai-powered.com/mcp/rea): REA is an open-source MCP server for developer tools.
- [Codebase Memory](https://ai-powered.com/mcp/codebase-memory): Codebase Memory is an open-source MCP server for knowledge and memory.
- [GitHub](https://ai-powered.com/mcp/github-2): GitHub is an open-source MCP server for developer tools.
- [Serena MCP: the IDE for your agent](https://ai-powered.com/mcp/serena-mcp-the-ide-for-your-agent): Serena MCP: the IDE for your agent is an open-source MCP server for developer tools.
- [XERJ](https://ai-powered.com/mcp/xerj): XERJ is an open-source MCP server for knowledge and memory.
- [Ouroboros](https://ai-powered.com/mcp/ouroboros): Ouroboros is an open-source MCP server for developer tools.
- [Claude Code Ultimate Guide](https://ai-powered.com/mcp/claude-code-ultimate-guide): Claude Code Ultimate Guide is an open-source MCP server for ai models and llm tooling.
- [Google Ads + Meta Ads + SEO/GEO MCP](https://ai-powered.com/mcp/google-ads-meta-ads-seo-geo-mcp): Google Ads + Meta Ads + SEO/GEO MCP is a freemium MCP server for marketing and seo.

---
Source: https://ai-powered.com/mcp/website-tech-stack-seo-and-llms-txt-check
