# Agent Data Tools: Web, documents and search

> Agent Data Tools: Web, documents and search is a freemium MCP server for web search and scraping. 42 tools for reading web pages, JS apps, PDFs, feeds and sitemaps as text. It runs as a hosted remote server, so there is nothing to install locally.

- **Kind:** MCP server
- **Pricing:** Freemium
- **Starting price:** $9 a month
- **Platforms:** API
- **Website:** https://agent-data-tools.revmesh2074.workers.dev
- **Repository:** https://github.com/nutshell2000/agent-data-tools
- **MCP Registry name:** io.github.Nutshell2000/agent-data-tools-web
- **Categories:** web search and scraping
- **Listing updated:** 2026-11-14

## About

The web section of the Agent Data Tools catalogue covers 42 tools for turning online material into text an agent can use: web pages, JavaScript apps and PDFs as text, plus feeds, sitemaps and search. The site's own guide singles out the documentation page reader, which returns clean text, Markdown, code and tables for $0.002 per successful call in USDC on Base.

That reader handles static public HTML, Markdown or plain text only, with no JavaScript rendering, authenticated pages or paywall access; the separate rendering tools are for JavaScript pages. AI, rendering and search tools are excluded from the free allowance, which is 25 successful calls over MCP, with failed calls never counted or charged.

Payment is per call in USDC through x402 or by prepaid card credits, with no account needed. The same catalogue also sells PDF-to-text and page-to-Markdown APIs by monthly plan from $9, and the operator is SpellzCode.

## Features

- **Page reader:** Returns clean text, Markdown, code and tables from public documentation pages.
- **PDF to text:** Reads PDFs as text.
- **Feeds and sitemaps:** Reads RSS feeds and sitemaps and gives link previews.
- **JavaScript pages:** Rendering tools cover JavaScript apps.
- **Web search:** Search tools sit in the same section.
- **Pay per call:** From $0.002 per successful call, with failed calls never charged.

## Good for

- Feed documentation pages to an LLM as clean Markdown
- Extract text from a PDF at a URL
- Monitor an RSS feed or sitemap
- Preview links an agent is about to cite

## Install

### Claude Code (Terminal)

```sh
claude mcp add --transport http agent-data-tools-web https://agent-data-tools.revmesh2074.workers.dev/mcp/web
```

### Claude Desktop (Settings → Connectors → Add custom connector)

```sh
https://agent-data-tools.revmesh2074.workers.dev/mcp/web
```

### Cursor (~/.cursor/mcp.json)

```json
{
  "mcpServers": {
    "agent-data-tools-web": {
      "url": "https://agent-data-tools.revmesh2074.workers.dev/mcp/web"
    }
  }
}
```

### VS Code (.vscode/mcp.json)

```json
{
  "servers": {
    "agent-data-tools-web": {
      "type": "http",
      "url": "https://agent-data-tools.revmesh2074.workers.dev/mcp/web"
    }
  }
}
```

### Windsurf (~/.codeium/windsurf/mcp_config.json)

```json
{
  "mcpServers": {
    "agent-data-tools-web": {
      "serverUrl": "https://agent-data-tools.revmesh2074.workers.dev/mcp/web"
    }
  }
}
```

### Other clients (your client's MCP settings (most use this shape))

```json
{
  "mcpServers": {
    "agent-data-tools-web": {
      "type": "http",
      "url": "https://agent-data-tools.revmesh2074.workers.dev/mcp/web"
    }
  }
}
```

## Tools

- `search`: Exa-style web search: top 1-20 results with title, URL, snippet, published date and favicon (Brave index); optional domain, date, category and phrase filters; optional live page text, highlights and AI summaries of the top 10 pages. Results are for immediate use only: no storing, resale or model training (Brave API terms). Failures return 503, uncharged. Use when an agent needs current information
- `pack_web_research`: One call to research a question on the web: a Brave web search, then the text of the top 1-5 result pages, read in parallel and clipped to your length, with titles and URLs. A page that cannot be read is listed with its reason. Results are for the caller's immediate use only: no storing, resale or model training (Brave API terms). Use when an agent needs current, sourced information in one step in
- `news`: News headlines on any topic, crypto included, as JSON: title, URL, snippet, publisher domain and age, from the Brave Search API's news index. 1-20 results per call; freshness limits results to the past day, week or month. Results are for the caller's immediate use only: no storing, resale or model training (Brave API terms). Upstream failures return 503, uncharged. Use when an agent needs current 
- `pack_news_sentiment`: Brand sentiment from the news on a topic in one call: the latest headlines from the Brave News index (title, URL, publisher, age), each with a positive or negative score from a DistilBERT model, and the balance across them. Up to 10 articles from the past day, week or month. Not a market signal. Results are for the caller's immediate use only (Brave API terms). Use for a market mood check, brand m
- `contents`: Read one to five public web pages in one call and get each one's clean text (or Markdown), title, author and published date where the page declares them, in the request shape search APIs use (urls as a list). Pages are read in parallel; one that cannot be read is listed in statuses with its reason and the rest still answer. Static HTML, Markdown and plain text, up to 20,000 characters a page. Use 
- `image_metadata`: Read an image's metadata from its URL: format (JPEG, PNG, GIF or WebP), width and height, and for JPEG photos the EXIF data: camera make and model, lens, date taken, exposure, aperture, ISO, focal length, orientation, software and the GPS position (latitude, longitude, altitude) when it was recorded. Up to 15 MB. Use to check where and when a photo was taken, verify an upload, or strip-check image
- `url_favicon`: Find a website's icons: every <link rel=icon>, shortcut icon, apple-touch-icon and mask-icon on the page with its size and type, the web app manifest link, and whether /favicon.ico exists, all as absolute URLs, with the best icon picked (SVG, then the largest size; mask icons never). Use to show a site's logo next to a link, build bookmarks or enrich a company record. Example: url=https://github.c
- `pack_seo_toolkit`: One call for an on-page SEO analysis of a URL: the SEO audit (title and description lengths, canonical, headings, alt text, structured data, score, issues), the top keywords and two-word phrases with their density, the social preview (OpenGraph, Twitter card), the favicon, and robots.txt access with its sitemaps. Server HTML only. Cheaper than the tools one by one. Use before publishing, for an SE
- `tech_stack`: Detect the technologies behind a website from its home page HTML and response headers: CMS or site builder (WordPress, Shopify, Webflow…), JavaScript framework (Next.js, Nuxt, React…), analytics and ad pixels, support widgets, payments, captcha, CDN and hosting, web server and backend language, each with the evidence that matched. About 110 public fingerprints, server HTML only. Use for lead resea
- `extract`: Fetch any public web page URL and get clean, LLM-ready text or Markdown: main content, code blocks, tables, links and headings, for RAG and agent context. Static HTML, Markdown or text; optional section ID. Default 20,000 output characters, max 100,000; input 2 MiB. No JavaScript rendering (see /extract/rendered), logins or paywalls. Empty pages, bad sections, browser challenges and errors are not
- `extract_rendered`: Same output as /extract, but the page is first rendered in a real browser, so single-page apps and pages that build their content with JavaScript come back with their text instead of an empty shell. Waits for the network to settle (up to 15 seconds). Public pages only; no login. Use when /extract returns EXTRACTION_EMPTY or too little text for a page you can read in a browser. Example: url=https:/
- `pdf_text`: Extract the text of a public PDF (up to 10 MB) from its URL, page by page, with title, author and page count. Choose the first page, how many pages (up to 200) and maxChars. arXiv abstract links work. If a site blocks our fetch, the Internet Archive's dated copy is read and the answer says so. Scanned, encrypted and non-PDF files fail uncharged. Use to read papers, invoices, reports and manuals in
- `sitemap`: Sitemap parser: reads one public XML sitemap or sitemap index as structured URLs and source-reported dates. Supports gzip, substring filtering and pagination. Large sitemaps are read from the start (512 KiB, 1000 entries at most, with a warning). Does not crawl pages or follow child sitemaps. Invalid XML and execution errors are not charged; a valid empty match is charged. Use to find which pages 
- `summarize`: Give a URL, get a short summary of the page plus three to six key points, ready to drop into an agent's context. Fetches the page, strips navigation and boilerplate, and summarizes the main text with an LLM. HTML pages only; for a PDF use pdf_text, then ai_summarize_text. Use for research, news triage, link previews and deciding whether a page is worth reading in full. For the full text use extrac
- `screenshot`: Render any public web page in a real headless Chrome browser, with JavaScript executed, and get a JPEG screenshot (1280 px wide, base64) plus the final URL, HTTP status and page title. Set fullPage=true to capture up to 4000 px of page height. Use for visual checks, page previews, monitoring and feeding pages to vision models. Example: url=https://example.com. Price $0.01/call via x402 USDC or a c
- `papers`: Research papers search across journals, conferences, preprints and books (Crossref): title, authors, year, venue, citation count, DOI link and abstract where available. Optional fromYear filter and up to 20 results per call. Use for research agents, literature reviews, fact-checking a claim against published work, and finding the DOI for a citation. Example: query=CRISPR off-target effects. Price 
- `arxiv_search`: Search arXiv, the open preprint server for physics, mathematics, computer science and AI: give search words (every word must match, quotes for a phrase) and optionally a category such as cs.AI, and get 1-20 papers by relevance or newest first, each with title, abstract, authors, dates, categories, DOI and PDF link. An arXiv ID or link returns that paper. Use to find research on a topic, cite a pap
- `document_text`: Convert a document to text or Markdown: Word (.docx) with headings, lists and tables, Excel (.xlsx) sheet by sheet, PowerPoint (.pptx) slide by slide, a PDF's text, and scanned PDFs or images (PNG, JPEG, WebP) by OCR. Give a public file's URL, or send the file in a POST body (10 MB; images 3 MB). Old .doc/.xls/.ppt and password-protected files fail uncharged. Use to read attachments, scans and spr
- `document_extract`: Extract named fields from a document as JSON: give a PDF, Word, Excel or PowerPoint file, a scan or a photo (PNG, JPEG, WebP) by URL or in a POST body (up to 10 MB; images 3 MB) and the field names you want, such as invoice_number, total, due_date. An AI model reads the file, scans by OCR, and returns one JSON object, with null where a value is not stated. Use to turn invoices, receipts, orders an
- `feed`: Read a public RSS 2.0, RSS 1.0 or Atom feed and get the feed title, link and description plus its newest items: title, link, date (ISO 8601), short plain-text summary, author and id. Up to 50 items, feeds up to 2 MB. Lenient with real-world feeds; a page that is not a feed returns 422, uncharged. Use to follow news, blogs, release notes or podcasts without scraping pages. Example: url=https://hnrs
- `url_meta`: Fetch a public web page's head and return link-preview metadata: title, description, site name, type, preview image, canonical URL, language, author, published time, favicon, theme colour, and every OpenGraph and Twitter-card field. Reads at most 1 MB and never runs JavaScript. Use to build link previews, label citations or check how a URL will unfurl before sharing it. Example: url=https://github
- `agent_readiness`: Score how ready a website is for AI agents, 0-100: llms.txt, sitemap, OpenAPI spec, MCP server card, A2A agent card and x402 payment discovery, each found or missing with its URL, which AI crawlers (GPTBot, ClaudeBot, PerplexityBot and others) robots.txt lets in, and a list of fixes. Reads only the public files a site publishes; nothing is signed in or submitted. Use to audit your own site or vet 
- `robots`: Read a site's robots.txt and say whether a crawler may fetch a URL, by RFC 9309 rules as Google applies them (most specific user-agent group, longest matching Allow or Disallow, Allow on ties, * and $ wildcards). Returns the deciding rule, the group used, the rule count and the sitemaps listed. A missing robots.txt (4xx) allows everything. Use before scraping or crawling a site politely; for the s
- `url_redirects`: Follow a URL's redirects hop by hop (up to 10) and return every hop's status code and Location, the final URL, total hops, timing and whether it loops. Expands short links (bit.ly, t.co…) to their destination without loading the page. Every hop is checked before it is requested; redirects to private addresses are reported, not followed. Use to unshorten a link, check an HTTPS or www redirect, or d
- `url_uptime`: Check whether a website is up right now: one live request (following redirects) with the HTTP status, up or down, response time in ms, the final URL, content type, server header and page size, and optionally whether the page contains a given text. Timeouts and connection failures come back as down with the reason, not as an error. Use for uptime monitoring, health checks before calling an API, or 
- `seo_audit`: On-page SEO audit of one URL: title and meta description with their lengths, canonical, meta robots, H1s and H2 count, images without alt text, lang and viewport, Open Graph and Twitter card tags, JSON-LD blocks, internal and external link counts and word count, plus a list of issues and a 0-100 score. Reads the server's HTML (no JavaScript), up to 1 MB. Use to check a page before publishing or to
- `audit_website`: Full website audit of one URL from a single load in a real browser: WCAG 2.1 A/AA accessibility violations with axe-core (rule, impact, elements, fix link), page speed (first byte, FCP, LCP, layout shift) and page weight by type, on-page SEO on the rendered page, and HTTP security headers with a grade. One overall score and the top issues. Use for a site or client report, before a launch, or to co
- `page_publish`: Publish an HTML page and get a public URL for it (valid up to 7 days): send the HTML (up to 200,000 characters) and an optional title; the page is sanitised (no scripts, styles, frames, forms or event handlers; links and https images stay), screened by content moderation, stored, and served at /p/<id> with noindex. Use to hand a person a report, table or summary your agent produced, or to share re
- `wikipedia`: Short summary of a Wikipedia article in any language edition: title, one-paragraph extract, description, thumbnail and page URL. Use to ground an agent's answer in a quick, citable fact sheet. Example: title=Stockholm. Price $0.002/call via x402 USDC or a card key (/credits), first 25 free; failed calls free. Reads or computes only and changes nothing; each call is charged, so repeats are not free
- `dictionary`: Dictionary definition of an English word from Wiktionary, grouped by part of speech, with example sentences where Wiktionary gives them, plus the page link and the CC BY-SA attribution to show. Use for writing help, vocabulary, translation checks and word games. Example: word=serendipity. Price $0.01/call via x402 USDC or a card key (/credits), first 25 free; failed calls free. Reads or computes o
- `search_web`: Web search API for agents: search the web and get the top results as JSON (title, URL, snippet, published date, domain), optionally with the page text, highlights and a summary of each result, and filters by domain, date range and category. Results are for immediate use only (Brave API terms); failures are uncharged. Use when an agent needs current information, sources or links from the open web. 
- `news_search`: News search API: current news articles on any topic from the Brave news index, as JSON with title, URL, snippet, publisher and age, 1-20 results, optionally only from the past day, week or month. Results are for immediate use only (Brave API terms). Use when an agent needs the latest news or headlines on a company, coin, person or event. Example: q=bitcoin ETF. Price $0.01/call via x402 USDC or a 
- `screenshot_website`: Website screenshot API: render any public web page in a real headless Chrome browser with JavaScript executed and get a JPEG screenshot (1280 px wide, base64) plus the final URL, HTTP status and title; fullPage=true captures up to 4000 px of height. Use for visual checks, previews, monitoring and archiving a page as an agent sees it. Example: url=https://example.com. Price $0.01/call via x402 USDC
- `scrape`: Web scraping API: fetch any public web page URL and get its main content as clean text or Markdown (headings, code blocks, tables and links kept), ready for an LLM, RAG or an agent's context; static HTML, Markdown or text pages, up to 100,000 characters. JavaScript-rendered pages: /extract/rendered. Empty pages, bot walls and errors are never charged. Use to read articles, docs and product pages a
- `page_host`: Host a static web page: send HTML (up to 200,000 characters) and an optional title and get a public URL at once, valid up to 7 days; the page is sanitised (no scripts, styles, frames or forms), screened by content moderation and served with noindex. Use to hand a person a report, dashboard or summary your agent produced, or to share results between agents. Price $0.01/call via x402 USDC or a card 
- `web_search`: Web search: send a query and get the top web results as JSON (title, URL, snippet, published date), optionally with page text and highlights, filtered by domain, date or category. Results are for immediate use only (Brave API terms); failures are uncharged. Use when an agent needs current facts, sources or links. Example: q=x402 payment protocol. Price $0.01/call via x402 USDC or a card key (/cred
- `pdf_extract`: Extract text from a PDF by URL: the text of each page of a public PDF file (up to 10 MB), with the page count, title and author; scanned PDFs without a text layer fail uncharged. Use to read reports, papers, invoices and filings into an LLM, RAG or an agent's context. Example: url=https://bitcoin.org/bitcoin.pdf. Price $0.005/call via x402 USDC or a card key (/credits), first 25 free; failed calls
- `page_markdown`: Web page to Markdown: give a public URL and get the page's main content as clean Markdown for an LLM, with headings, links, lists, tables and code blocks kept and navigation, ads and scripts removed, up to 100,000 characters; static HTML, Markdown and text pages. Bot walls, empty pages and errors are never charged. Use to put an article, documentation page or blog post into a prompt, a RAG index o
- `wiki_summary`: Wikipedia summary of an article by its title: the one-paragraph extract in plain text with the short description, the page link and the thumbnail image, from the English edition or any other language edition, with the CC BY-SA attribution to show. Use to get quick background on a subject, ground an answer in a citable encyclopedia source, or check what a name refers to. Example: title=Stockholm. P
- `web_fetch`: Web fetch for agents: fetch any public URL and get the page's main content as clean text or Markdown (headings, links, tables and code blocks kept), up to 100,000 characters; static HTML, Markdown and text pages. Bot walls, empty pages and errors are never charged. Use to read a web page, article or documentation URL into an LLM's context or a RAG pipeline. Example: url=https://example.com. Price 
- `tech_detect`: Website technology detection: which CMS or site builder, JavaScript framework, analytics and ad pixels, payment, support and captcha widgets, CDN, hosting and web server a site runs on, read from its home page HTML and response headers, each with the evidence found. Use for lead qualification, competitor research, security reviews and sales prospecting by technology. Example: url=https://vercel.co
- `crypto_news`: Crypto news today: the latest cryptocurrency headlines (bitcoin, ethereum, DeFi, regulation, markets), or news on any coin or topic you name, as JSON with title, URL, snippet, publisher and age, 1-20 results, from the past day unless you choose a week or month. Results are for immediate use only (Brave API terms). Use to brief a trading agent, follow a coin's news or build a daily crypto digest. E
- `url_unshorten`: URL unshortener: expand a short link (bit.ly, t.co and others) to its final destination without loading the page, with every redirect hop's status code and Location, total hops, timing and whether it loops. Each hop is checked before it is requested; redirects to private addresses are reported, not followed. Use to see where a link really goes before opening or sharing it. Example: url=http://gith
- `exif`: EXIF data of a photo from its URL: camera make and model, lens, date taken, exposure, aperture, ISO, focal length, orientation, software and the GPS position (latitude, longitude, altitude) when it was recorded, with the image format, width and height. JPEG EXIF; PNG, GIF and WebP give size only. Up to 15 MB. Use to check where and when a photo was taken or to verify an upload. Example: url=https:

## FAQ

### What can the page reader not do?

It does not render JavaScript or reach authenticated or paywalled pages.

### How much does a page read cost?

$0.002 in USDC on Base per successful call.

### Are search and rendering tools free to try?

No. AI, rendering and search tools are excluded from the free calls.

### Is there a monthly plan?

Separate PDF and page-to-Markdown APIs are sold by monthly plan from $9, paid by card.

### Is Agent Data Tools: Web, documents and search free?

Agent Data Tools: Web, documents and search has a free plan, with paid plans for more usage or features. Paid plans start at $9 a month.

### How do I add Agent Data Tools: Web, documents and search to Claude Code?

Run this command in your terminal: claude mcp add --transport http agent-data-tools-web https://agent-data-tools.revmesh2074.workers.dev/mcp/web

### What are the best alternatives to Agent Data Tools: Web, documents and search?

The closest alternatives to Agent Data Tools: Web, documents and search are Scrapling MCP Server, Firecrawl MCP Server, SearXNG Search, NeuralVerge and AI-Powered directory.

## Alternatives

- [Scrapling MCP Server](https://ai-powered.com/mcp/scrapling-mcp-server): Scrapling MCP Server is an open-source MCP server for web search and scraping.
- [Firecrawl MCP Server](https://ai-powered.com/mcp/firecrawl-mcp-server): Firecrawl MCP Server is a freemium MCP server for web search and scraping.
- [SearXNG Search](https://ai-powered.com/mcp/searxng-search): SearXNG Search is an open-source MCP server for web search and scraping.
- [NeuralVerge](https://ai-powered.com/mcp/neuralverge): NeuralVerge is an MCP server for web search and scraping.
- [AI-Powered directory](https://ai-powered.com/mcp/ai-powered-directory): AI-Powered directory is a free MCP server for developer tools.
- [Shopify MCP Server (any store)](https://ai-powered.com/mcp/shopify-mcp-server-any-store): Shopify MCP Server (any store) is a paid MCP server for e-commerce.
- [Chanroll: YouTube Channel Video Scraper (Official API)](https://ai-powered.com/mcp/chanroll-youtube-channel-video-scraper-official-api): Chanroll: YouTube Channel Video Scraper (Official API) is a paid MCP server for design and media.
- [Vidvett: YouTube Video Details Scraper (Official API)](https://ai-powered.com/mcp/vidvett-youtube-video-details-scraper-official-api): Vidvett: YouTube Video Details Scraper (Official API) is a paid MCP server for design and media.

---
Source: https://ai-powered.com/mcp/agent-data-tools-web-documents-and-search
