Skip to main content

run_cu_server

Function run_cu_server 

Source
pub fn run_cu_server(addr: String)
Expand description

Expose the captured desktop to an AI agent over HTTP, so a Computer Use client can drive the session much as a human viewer would.

It runs on its own thread listening on addr for POST /computer-use JSON actions (screenshot, mouse_move, click, key, scroll, …). The backend and the framebuffer dimensions are re-resolved on every request rather than cached, because the compositor can start, the stream can resize, or the X server can restart underneath the agent — a stale size would misplace every coordinate. On Wayland a screenshot forces a one-frame GPU readback when the pipeline is in zero-copy mode; on X11 it is a one-shot GetImage of the root window.