This repo connects an agent to Windows through MCP tools for clicking, typing, screenshots, OCR, and UI inspection. It can also run as an autonomous mission engine that plans, retries, verifies, and reports on desktop tasks.
Builders who want an agent to operate Windows apps, inspect screens, and carry out multi-step desktop work.
You can have an agent control Windows software directly instead of asking you to click through every step.
Exposes 22 MCP tools for mouse, keyboard, screenshot, OCR, and UI inspection.
Runs goal-based jobs that plan actions, retry failures, and verify the result.
Provides a browser dashboard with human-in-the-loop controls, logging, and crawler views.
Bundles the system into a Windows app through Tauri and NSIS.
Logs actions to SQLite and supports macro recording and replay for repeatable workflows.
Finds UI targets using title, IDs, class names, and OCR fallbacks.
A tool for agents, and an agent itself.
| You | It |
|---|---|
| Use it as an MCP server | Claude, Cursor, DeepSeek call automation_click, automation_screenshot, automation_ocr — 22 tools |
| Use it as an autonomous agent | Give it a goal: automation_mission(run="install app, verify UI, screenshot result") — it plans, executes, retries, and reports |
| Use it as a webapp | start.ps1 opens a React dashboard at http://127.0.0.1:10788 with HITL, crawler, logging |
| Use it as a desktop app | The NSIS installer bundles everything into one binary — no Python, no uv, no git needed |
Exhibit A: 100 Tauri/NSIS installers, one unattended run, $2 in LLM costs. Install, screenshot, verify, report — zero human intervention. That is what agentic Windows automation looks like at scale.
Built on pywinauto. Read docs/SAFETY.md before production use.
| Method | Command / Config |
|---|---|
| MCP stdio (Cursor, Claude Desktop) | { "mcpServers": { "windows-computer-use": { "command": "uv", "args": ["--directory", "<PATH>", "run", "windows-computer-use-mcp"] } } } |
| HTTP streamable (any MCP HTTP client) | { "mcpServers": { "windows-computer-use": { "url": "http://127.0.0.1:10789/mcp" } } } |
| Web operator UI | .\start.ps1 → http://127.0.0.1:10788 |
| Desktop app (NSIS installer) | Download from Releases — zero deps |
See INSTALL.md for detailed setup. Run just demo for examples.
| Doc | Content |
|---|---|
| INSTALL.md | Setup: desktop app, uv, MCP config |
| docs/README.md | Full documentation hub |
| docs/py-stack.md | Python dependency deep dive |
| docs/composing-with-playwright.md | Browser automation with Playwright MCP |
| docs/ocr.md | OCR system — Tesseract setup, limitations, competition |
| docs/cua-nsis-certification.md | Dogfooding: using the tool to test its own NSIS installer |
| docs/ROADMAP.md | Improvement roadmap short/medium/long term |
| docs/SAFETY.md | HITL, kill switch, opt-in features |
| docs/TOOLS.md | Portmanteau tool reference |
| tests/README.md | Test suite guide and e2e setup |
| examples/README.md | Runnable demos |
| mcpb/README.md | MCPB bundle packaging |
| web_sota/README.md | Operator UI build/dev guide |
| CHANGELOG.md | Release history |
| Port | Service |
|---|---|
| 10788 | Frontend — Vite operator UI |
| 10789 | Backend — FastAPI + FastMCP HTTP |
| stdio | MCP transport (port-free) |
| Repo | What it does |
|---|---|
| autohotkey-mcp | Raw input recording/replay via AHK |
| browser-mcp | Playwright browser control — for webapps, HTML DOM, websites |
| virtualization-mcp | Sandbox / VM isolation |
| windows-operations-mcp | Registry, services, accounts |
Browser vs desktop: This server drives Win32 / UI Automation. For HTML/DOM and websites, pair with browser-mcp (Playwright). Both MCPs can run side by side — use one profile that loads both and let the LLM pick the right tool for the target.
Fleet standards: mcp-central-docs.
MIT — Copyright (c) 2026 Sandra Schipal.
Sign in to join the discussion.
No comments yet. Be the first to say what this is good for.
High-performance code intelligence MCP server. Indexes codebases into a persistent knowledge graph — average repo in milliseconds. 158 languages, sub-ms queries, 99% fewer tokens. Single static binary, zero dependencies.
Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code
Git-native persistent memory for AI coding agents. Implements Google OKF v0.2 with sub-300µs in-memory BM25 search, embedded MCP server, and progressive disclosure. Slashes token bloat by 80% with zero external databases or dependencies. Built in pure Go.
Local-first code intelligence graph for MCP and CLI. Builds a persistent map of your codebase so AI coding tools read only what matters, with benchmarked context reductions on reviews and large-repo workflows.
Stop your AI from making things up — it proposes, deterministic tools decide, every claim checked against ground truth with evidence. Grounded facts and context survive resets. Reverse engineering is the proving ground. MCP server + CLI.
20 MB lightweight cross-platform database client for 90+ databases, including MySQL, PostgreSQL, SQLite, Redis, MongoDB, DuckDB, SQL Server, and Dameng. Built-in AI, MCP Server, CLI, desktop and Docker. | 轻量级跨平台数据库管理工具，支持 MySQL、PostgreSQL、SQLite、Redis、MongoDB、达梦等 90+ 数据库，提供桌面端、Docker、CLI、内置 AI 助手和 MCP Server。
