# Screen Control

> Screen Control is an MCP server for agent tooling. Local HTTP and MCP server letting AI agents see and control a Windows or X11 desktop. It is available on Windows, Linux, API, CLI and self-hosted.

- **Kind:** MCP server
- **Platforms:** Windows, Linux, API, CLI, self-hosted
- **Repository:** https://github.com/xeakaes/computer-use-for-all-agents
- **MCP Registry name:** io.github.Xeakaes/computer-use-for-all-agents
- **Categories:** [agent tooling](https://ai-powered.com/categories/agent-tooling)
- **Listing updated:** 2026-11-18

## About

The README says this is a self-hosted bridge between AI agents and a desktop computer. A server running on the user's own machine captures the screen, reads text with OCR, and sends mouse and keyboard input, with all traffic kept on localhost by default rather than routed through a cloud service.

Agents can reach it either through a REST API with a token header or through an MCP server (stdio or streamable HTTP) that exposes around sixteen tools. Perception options include single frames, an MJPEG stream, OCR, and a text-based diff for models that cannot process images. Window tools cover listing, focusing, closing, and background input on Windows.

Safety controls are enforced server-side: a per-start auth token, blocked dangerous key combinations, a focus guard that refuses typing into the wrong window, and a watchdog that releases stuck keys. The project suits developers and agent builders who want desktop automation on hardware they control. Windows is the reference platform, Linux is supported on X11 with limits, and macOS is a stub.

## Features

- **Screen capture and OCR:** Grabs full screens or regions as JPEG and extracts on-screen text with coordinates.
- **Mouse and keyboard input:** Sends clicks, drags, scrolls, Unicode typing and key combinations through the API.
- **Window management:** Lists, focuses, safely closes or kills windows and can launch applications.
- **Vision and motion access:** Provides single frames, an MJPEG stream and a text-only motion diff for different model types.
- **MCP and REST interfaces:** Offers the same controls over MCP for compatible clients or plain HTTP for scripts.
- **Server-side safety gates:** Requires a token, blocks Alt+F4 and similar combos, and guards focus before typing.

## Good for

- Letting an AI agent operate desktop applications that have no API
- Automating repetitive GUI tasks on a local Windows machine
- Reading on-screen text through OCR for agent verification loops
- Driving turn-based or click-based games with agent control
- Testing desktop software by scripting clicks and captured screenshots

## FAQ

### Does any data leave the machine?

The README says everything runs locally and no data leaves the machine, though a user can opt into a Cloudflare tunnel to expose the MCP endpoint.

### Which operating systems are supported?

Windows 10 and 11 are the reference platform. Linux works on X11 sessions only, with limits, and Wayland is refused at startup. macOS is a stub that returns unavailable.

### Is there a licence or price?

The README does not state a licence or pricing in the content provided.

### Can it be used with Claude Desktop?

Yes, the README gives a configuration example for Claude Desktop using the stdio transport of mcp_server.py.

### What are the best alternatives to Screen Control?

The closest alternatives to Screen Control are toolhive, mcp-gateway-registry, Synapbus, Seedance 2.0 MCP and Z-Image MCP.

## Where this comes from

- Description: written from the project's README and its MCP Registry entry.

## Alternatives

- [toolhive](https://ai-powered.com/mcp/toolhive): toolhive is an open-source MCP server for agent tooling.
- [mcp-gateway-registry](https://ai-powered.com/mcp/mcp-gateway-registry): mcp-gateway-registry is an open-source MCP server for agent tooling.
- [Synapbus](https://ai-powered.com/mcp/synapbus): Synapbus is an open-source MCP server for agent tooling.
- [Seedance 2.0 MCP](https://ai-powered.com/mcp/seedance-2-0-mcp): Seedance 2.0 MCP is an open-source MCP server for design and media.
- [Z-Image MCP](https://ai-powered.com/mcp/z-image-mcp): Z-Image MCP is a freemium MCP server for design and media.
- [Tiramisu AI MCP](https://ai-powered.com/mcp/tiramisu-ai-mcp): Tiramisu AI MCP is an open-source MCP server for design and media.
- [Meigen AI MCP](https://ai-powered.com/mcp/meigen-ai-mcp): Meigen AI MCP is an open-source MCP server for design and media.
- [Hive Connector](https://ai-powered.com/mcp/hive-connector): Hive Connector is a freemium MCP server for agent tooling.

---
Source: https://ai-powered.com/mcp/screen-control
