Website Tech Stack, SEO & llms.txt Check
One-row-per-site audit of tech stack, SEO issues, AI-bot rules, sitemap and llms.txt
- Pricing
- Paid
- Platforms
- API, Web
- Runs
- Remotely
- Version
- 1.0.0
- Listing updated
- 2 days ago
About Website Tech Stack, SEO & llms.txt Check
Website Tech Stack, SEO & llms.txt Check is a paid MCP server for marketing and seo. It runs as a hosted remote server, so there is nothing to install locally.
Each site you pass in becomes a single structured row. It lists detected technologies by category, title and meta tags, Open Graph and JSON-LD types, security headers, an SEO issue list with a 0 to 100 score, a separate 0 to 100 AI-readiness score, and whether robots.txt allows, partly blocks or blocks GPTBot, ClaudeBot, PerplexityBot, Google-Extended and CCBot.
Checks use plain HTTP with no browser, about 75 signatures from HTML, headers, cookies and meta generators, so detection is heuristic and single-page apps that render client-side may show a thin-content flag. It only checks the page you give it plus robots.txt, the sitemap and llms.txt files, and it identifies itself as FairqueryBot and respects robots.txt by default.
It suits lead enrichment, quick homepage audits and agents answering questions such as whether a site serves llms.txt. It does not do full crawls, Core Web Vitals or backlink data.
Install
Run in a terminal
claude mcp add --transport http website-tech-seo-ai-readiness 'https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness'Add to Settings → Connectors → Add custom connector
https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readinessAdd to ~/.cursor/mcp.json
{
"mcpServers": {
"website-tech-seo-ai-readiness": {
"url": "https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness"
}
}
}Add to .vscode/mcp.json
{
"servers": {
"website-tech-seo-ai-readiness": {
"type": "http",
"url": "https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness"
}
}
}Add to ~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"website-tech-seo-ai-readiness": {
"serverUrl": "https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness"
}
}
}Add to your client's MCP settings (most use this shape)
{
"mcpServers": {
"website-tech-seo-ai-readiness": {
"type": "http",
"url": "https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness"
}
}
}Tools this server provides (2)
Taken from the project documentation; the running server may differ.
- fairquery/website-tech-seo-ai-readiness
- Returns tech stack, SEO score, AI-bot rules, sitemap and llms.txt status for each site.
- fetch-actor-details
- Fetches details of the Actor.
What it does
- Tech stack detection
- Reports CMS, framework, analytics, chat, payments, CDN and hosting.
- SEO score
- Gives a 0 to 100 score with coded issues and severity.
- AI crawler rules
- Maps robots.txt access for major AI bots as allowed, partial or blocked.
- llms.txt check
- Looks for llms.txt and llms-full.txt and reads the title.
- Sitemap count
- Finds the sitemap and counts its URLs.
Good for
- Enrich a lead list with each company's website platform
- Check whether a site blocks GPTBot or ClaudeBot
- Spot-check landing pages for missing meta tags
- Score sites for AI-readiness before a content project
Pricing
Paid
From $1.00 to $1.50 per 1,000 sites depending on Apify plan; errors free
Prices change. Check apify.com before you buy.
Website Tech Stack, SEO & llms.txt Check FAQ
Does it crawl the whole site?
No. It fetches the page you supply plus robots.txt, sitemap and llms.txt files.
Does it run JavaScript?
No. It uses plain HTTP, so client-rendered apps may be flagged for thin content.
How much does it cost?
$1.50 per 1,000 sites on the Free plan, down to $1.00 on Business; sites that cannot be fetched are not charged.
How many sites fit in the free allowance?
Roughly 3,300 per month from the $5 of usage on Apify's Free plan.
Is Website Tech Stack, SEO & llms.txt Check free?
No. Website Tech Stack, SEO & llms.txt Check is a paid product.
How do I add Website Tech Stack, SEO & llms.txt Check to Claude Code?
Run this command in your terminal: claude mcp add --transport http website-tech-seo-ai-readiness 'https://mcp.apify.com/?tools=fetch-actor-details,fairquery/website-tech-seo-ai-readiness'
What are the best alternatives to Website Tech Stack, SEO & llms.txt Check?
The closest alternatives to Website Tech Stack, SEO & llms.txt Check are REA, Codebase Memory, GitHub, Serena MCP: the IDE for your agent and XERJ.
Alternatives to Website Tech Stack, SEO & llms.txt Check

REA
MCP serverCLI and MCP server that lets coding agents reverse engineer apps and binaries
Runs locally- Open source
- 464K GitHub stars
- Developer tools

Codebase Memory
MCP serverLocal MCP server that builds a code knowledge graph for AI coding agents
Runs locally- Open source
- 48.7K GitHub stars
- Knowledge and memory

GitHub
MCP serverOfficial MCP server connecting AI assistants to GitHub repos, issues and workflows
Not checked yet- Remote
- Open source
- 34.5K GitHub stars
- Developer tools

Serena MCP: the IDE for your agent
MCP serverMCP toolkit giving coding agents symbol-level code retrieval and editing
Runs locally- Open source
- 31.5K GitHub stars
- Developer tools

XERJ
MCP serverLocal search engine for AI agents with cited answers over your code and docs
Runs locally- Open source
- 19.2K GitHub stars
- Knowledge and memory

Ouroboros
MCP serverSpec-first layer that pins requirements and verifies results of AI coding agent work
Runs locally- Open source
- 6.4K GitHub stars
- Developer tools