Skip to content
MCP server

Website Tech Stack, SEO & llms.txt Check

One-row-per-site audit of tech stack, SEO issues, AI-bot rules, sitemap and llms.txt

Install
Pricing
Paid
Platforms
API, Web
Runs
Remotely
Version
1.0.0
Listing updated
2 days ago

About Website Tech Stack, SEO & llms.txt Check

Website Tech Stack, SEO & llms.txt Check is a paid MCP server for marketing and seo. It runs as a hosted remote server, so there is nothing to install locally.

Each site you pass in becomes a single structured row. It lists detected technologies by category, title and meta tags, Open Graph and JSON-LD types, security headers, an SEO issue list with a 0 to 100 score, a separate 0 to 100 AI-readiness score, and whether robots.txt allows, partly blocks or blocks GPTBot, ClaudeBot, PerplexityBot, Google-Extended and CCBot.

Checks use plain HTTP with no browser, about 75 signatures from HTML, headers, cookies and meta generators, so detection is heuristic and single-page apps that render client-side may show a thin-content flag. It only checks the page you give it plus robots.txt, the sitemap and llms.txt files, and it identifies itself as FairqueryBot and respects robots.txt by default.

It suits lead enrichment, quick homepage audits and agents answering questions such as whether a site serves llms.txt. It does not do full crawls, Core Web Vitals or backlink data.

Install

Run in a terminal

claude mcp add --transport http website-tech-seo-ai-readiness 'https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness'

Add to Settings → Connectors → Add custom connector

https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness
Install in CursorOpens Cursor, which asks you to confirm. Or add it by hand:

Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "website-tech-seo-ai-readiness": {
      "url": "https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness"
    }
  }
}
Install in VS CodeOpens VS Code, which asks you to confirm. Or add it by hand:

Add to .vscode/mcp.json

{
  "servers": {
    "website-tech-seo-ai-readiness": {
      "type": "http",
      "url": "https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness"
    }
  }
}

Add to ~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "website-tech-seo-ai-readiness": {
      "serverUrl": "https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness"
    }
  }
}

Add to your client's MCP settings (most use this shape)

{
  "mcpServers": {
    "website-tech-seo-ai-readiness": {
      "type": "http",
      "url": "https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness"
    }
  }
}

Tools this server provides (2)

Taken from the project documentation; the running server may differ.

fairquery/website-tech-seo-ai-readiness
Returns tech stack, SEO score, AI-bot rules, sitemap and llms.txt status for each site.
fetch-actor-details
Fetches details of the Actor.

What it does

Tech stack detection
Reports CMS, framework, analytics, chat, payments, CDN and hosting.
SEO score
Gives a 0 to 100 score with coded issues and severity.
AI crawler rules
Maps robots.txt access for major AI bots as allowed, partial or blocked.
llms.txt check
Looks for llms.txt and llms-full.txt and reads the title.
Sitemap count
Finds the sitemap and counts its URLs.

Good for

  • Enrich a lead list with each company's website platform
  • Check whether a site blocks GPTBot or ClaudeBot
  • Spot-check landing pages for missing meta tags
  • Score sites for AI-readiness before a content project

Pricing

Paid

From $1.00 to $1.50 per 1,000 sites depending on Apify plan; errors free

Prices change. Check apify.com before you buy.

Website Tech Stack, SEO & llms.txt Check FAQ

Does it crawl the whole site?

No. It fetches the page you supply plus robots.txt, sitemap and llms.txt files.

Does it run JavaScript?

No. It uses plain HTTP, so client-rendered apps may be flagged for thin content.

How much does it cost?

$1.50 per 1,000 sites on the Free plan, down to $1.00 on Business; sites that cannot be fetched are not charged.

How many sites fit in the free allowance?

Roughly 3,300 per month from the $5 of usage on Apify's Free plan.

Is Website Tech Stack, SEO & llms.txt Check free?

No. Website Tech Stack, SEO & llms.txt Check is a paid product.

How do I add Website Tech Stack, SEO & llms.txt Check to Claude Code?

Run this command in your terminal: claude mcp add --transport http website-tech-seo-ai-readiness 'https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness'

What are the best alternatives to Website Tech Stack, SEO & llms.txt Check?

The closest alternatives to Website Tech Stack, SEO & llms.txt Check are REA, Codebase Memory, GitHub, Serena MCP: the IDE for your agent and XERJ.

Alternatives to Website Tech Stack, SEO & llms.txt Check

  1. REA

    MCP server

    CLI and MCP server that lets coding agents reverse engineer apps and binaries

    Runs locally
    • Open source
    • 464K GitHub stars
    • Developer tools
  2. Codebase Memory

    MCP server

    Local MCP server that builds a code knowledge graph for AI coding agents

    Runs locally
    • Open source
    • 48.7K GitHub stars
    • Knowledge and memory
  3. GitHub

    MCP server

    Official MCP server connecting AI assistants to GitHub repos, issues and workflows

    Not checked yet
    • Remote
    • Open source
    • 34.5K GitHub stars
    • Developer tools
  4. MCP toolkit giving coding agents symbol-level code retrieval and editing

    Runs locally
    • Open source
    • 31.5K GitHub stars
    • Developer tools
  5. XERJ

    MCP server

    Local search engine for AI agents with cited answers over your code and docs

    Runs locally
    • Open source
    • 19.2K GitHub stars
    • Knowledge and memory
  6. Ouroboros

    MCP server

    Spec-first layer that pins requirements and verifies results of AI coding agent work

    Runs locally
    • Open source
    • 6.4K GitHub stars
    • Developer tools