Documentation
LLM-driven web scraping service for extracting structured data from sites at scale
- Platforms
- Web, API
- Listing updated
- 2 days ago
Similar tools
About Documentation
Documentation is an AI tool for web search and scraping. It is available on Web and API.
The Reworkd docs describe a platform that uses large language models to read, interpret and act on web pages, so users can pull data from sites without hand-writing selectors for each one. The introduction positions it as a way to collect large volumes of web data, with customers describing uses such as building products on constrained datasets, fine-tuning domain-specific models and enriching existing data pipelines.
The documentation walks through building a first scraper that can follow a site's sub pages, explaining key terms and then how to export the collected data. The docs also note that the team built AgentGPT, which is covered separately in the project's GitHub materials rather than here.
The product suits data teams and developers who need recurring extraction from many pages and want to hand parsing to a model rather than maintain brittle scraping code.
What it does
- LLM-based page parsing
- Uses language models to read and interpret web pages for extraction.
- Multi-page scraping
- Scrapes a site together with its sub pages in a single scraper.
- Data export
- Lets users export the data they have scraped.
- Scale-oriented extraction
- Positioned for collecting millions of rows of web data.
Good for
- Building datasets for products that depend on constrained web data
- Fine-tuning domain-specific language models on scraped content
- Enriching existing data pipelines with fresh web data
- Scraping a website and its sub pages into structured output
Documentation FAQ
What does Reworkd use to scrape pages?
The documentation says Reworkd uses LLMs to parse, understand and interact with web pages.
Can it scrape sub pages as well as the main site?
Yes, the docs include a guide on scraping a website and its sub pages.
How is scraped data got out of the platform?
The docs include a section on exporting the data you scrape.
What are the best alternatives to Documentation?
The closest alternatives to Documentation are Atlas, crawl4ai, Browser4 and Website.
Where this comes from
- Description: written from the project's website.

