[FEATURE] First-party desktop control (screen, mouse, keyboard) for any application

Status Open
Maintainer reply None cached
Activity 0 comments · opened Sep 23, 2026

Summary

Please ship a first-party desktop-control capability for Claude Code on Windows and
macOS: screen viewing plus mouse and keyboard control of any desktop
application, with the product's permission model built in.

Why

Third-party MCP servers such as Desktop Commander give a persistent shell and file
access, but they can't see the screen or drive applications. Claude in Chrome covers
Chrome only. Much real work lives in desktop apps with no API: Plex's server UI, a
backup tool, Bitdefender settings, media and office apps. Today the agent has to hand
those steps back to the user.

What I'm asking for

  • Screenshots of a chosen window or the whole screen, plus mouse and keyboard input,

working with any app.

  • Per-app permission on first use, a visible indicator whenever the agent is in

control, and one key to take control back instantly.

  • The same safety rules as the browser tools: no entering credentials or payments,

and confirmation before anything irreversible.

  • First-party maintenance, so users aren't trusting a third-party npm package with

control of their whole desktop.

(Also: if this lands, I'll happily beta-test it. A free month of Max 20x would help
me put it through its paces. 😄)

View original on GitHub ↗