Webshift vs Webshift
Webshift is an open-source MCP server for web search and scraping. Webshift is an open-source MCP server for web search and scraping.
- Webshift is best for giving an ai agent web search results as clean, size-capped text.
- Webshift is best for give an ai agent web search results as clean, budget-controlled text.
- What it is
- Webshift is an open-source MCP server for web search and scraping.Webshift is an open-source MCP server for web search and scraping.
- Best for
- Giving an AI agent web search results as clean, size-capped textGive an AI agent web search results as clean, budget-controlled text
- Kind
- MCP serverMCP server
- Pricing
- Open sourceOpen source
- Platforms
- CLI, API, Linux, macOS, Windows, self-hostedCLI, self-hosted, API
- Open source
- Good for
- Giving an AI agent web search results as clean, size-capped text; Cleaning HTML in a Rust pipeline before it reaches an LLM; Translating or rewriting text inside HTML without breaking tags or linksGive an AI agent web search results as clean, budget-controlled text; Clean scraped HTML in a Rust pipeline before sending it to an LLM; Translate or rewrite text inside HTML while keeping the markup intact
What Webshift does
HTML noise removal
Strips scripts, navigation, ads and similar page elements before returning plain text.
Budget-controlled output
Enforces per-page, total query and result-count limits so responses stay a predictable size.
Multiple search backends
Supports SearXNG, Brave, Tavily, Exa, SerpAPI, Google, Bing and a generic HTTP backend.
BM25 reranking
Ranks fetched pages deterministically with BM25, with optional LLM-assisted second-tier reranking.
Binary URL filtering
Drops links to binary files such as PDF or ZIP before any network request is made.
Text-map rewriting
Extracts text nodes from HTML and rebuilds the markup with only the text replaced.
What Webshift does
Noise removal from HTML
Strips scripts, navigation, ads and similar page elements before the text reaches the model.
Hard output size caps
Per-page, total-budget and result-count limits keep responses within a set character budget.
Streaming download limit
Caps how much of each page is downloaded, so large responses are not buffered in full.
BM25 reranking
Orders fetched sources by relevance with a deterministic BM25 pass, with optional LLM reranking on top.
Multiple search backends
Works with SearXNG, Brave, Tavily, Exa, SerpAPI, Google, Bing or a generic HTTP search endpoint.
Optional LLM features
Query expansion and Markdown summaries with citations are opt-in and work with OpenAI-compatible APIs.
Webshift vs Webshift: questions
Is Webshift or Webshift cheaper?
Both are open source. Compare current plans on each official site.
What is the difference between Webshift and Webshift?
Webshift is an open-source MCP server for web search and scraping. Webshift is an open-source MCP server for web search and scraping.