P
psyb0t/docker-auto-linux-desk
Full Linux desktop automation in Docker.
updated 2026-11-19
View on GitHub ↗Direct link · no redirect page
Official descriptionFull Linux desktop automation in Docker. An Xvfb + Openbox desktop you drive over a JSON HTTP API and MCP server: humanized OS-level mouse and keyboard input, window control, keyboard shortcuts, app launching, shell commands, screenshots and screen recording. Watch it live via noVNC. Base image for
After install: how to tell it works
- What you see after install — The command exits 0 and the terminal shows no "command not found" or "permission denied".
- One-line self-check — Run the smallest usage example from that repository's README. If the output matches what the README describes, it is working.
- If that does not work — This project has no troubleshooting notes. Search its issues for "install".
The install command comes from the repository; these checks describe observable results only and do not replace the project's own docs.
- Star count
- 0 ★ · psyb0t/docker-auto-linux-desk · read from the GitHub search API · (checked 2026-11-19 20:00:48)
- Source
- read directly from its GitHub page · type: open-source project
- Harvest history
- first seen 2026-11-20 · last seen 2026-11-20 · seen 1× · listed by 1 sources
- Score
- score 103 · 1 sources · repo
- Install
- see Install & config above
FAQ (answers come from our records)
Who is it for?
We filed it under these tags: Open Source. The tags come from the entry itself, not a taxonomy we imposed.
Who maintains it?
repository
psyb0t/docker-auto-linux-desk;first catalogued 2026-11-20;last seen 2026-11-20。There is no official certification or quality rating here — we record sources and dates only.README excerpt (English, untranslated) · Read the full README on GitHub →
# auto-linux-desk
Excerpted from the repository README (abridged)
A virtual Linux desktop in Docker that you drive over HTTP or MCP. One container runs Xvfb, the Openbox window manager, a noVNC viewer and an API that moves the real mouse with human motion, types with human rhythm, presses window manager shortcuts, arranges windows, starts programs, runs shell commands, reads and writes the clipboard, takes screenshots and records the screen.
Use it as it is for Linux desktop automation, or build your own image on it: a plugin adds actions for the software you install, such as a browser.
## Contents
Quick start
How it works
What it can do
Agent integrations
Script mode
Building on it
Configuration and security
Documentation
Development
Sponsor
License
## Quick start
bash
docker run -d --name desk \
-p 127.0.0.1:8080:8080 \
-p 127.0.0.1:5900:5900 \
psyb0t/auto-linux-desk
Open http://localhost:5900/ to watch the screen. Port 8080 serves the HTTP API and the MCP endpoint at /mcp/.
bash
# Open a terminal with the window manager shortcut
curl -X POST http://localhost:8080 \
-H "Content-Type: application/json" \
-d '{
"action": "send_key",
"key": "ctrl+alt+t"
}'
# Type into it with human keystrokes
curl -X POST http://localhost:8080 \
-H "Content-Type: application/json" \
-d '{
"action": "system_type",
"text": "uname -a\n"
}'
# Or run a command directly
curl -X POST http://localhost:8080 \
-H "Content-Type: application/json" \
-d '{
"action": "run_command",
"command": "ls -la /userdata"
}'
# Look at the screen
curl "http://localhost:8080/screenshot/desktop?whLargest=512" -o desk.png
The example keeps both ports on loopback. Read configuration and security before making them reachable from another machine.
## How it works
One container owns one desktop. HTTP requests and MCP tools call the same action dispatcher; run_script keeps several steps under one request lock. The noVNC viewer shows the same screen the agent controls.
| Component | Purpose |
| Xvfb and Openbox | Virtual screen, windows, focus, tiling and keyboard shortcuts. |
| PyAutoGUI and XTest | OS-level mouse, keyboard and wheel input with humanized motion and timing. |
| D-Bus and AT-SPI2 | Read and act on widgets that desktop apps expose to accessibility clients. |
| HTTP API and MCP | Control the desktop on port 8080; MCP uses /mcp/. |
| x11vnc and noVNC | Watch and control the desktop in a browser on port 5900. |
| ffmpeg, scrot and xclip | MP4 recordings, PNG screenshots and the shared X11 clipboard. |
## What it can do
| Area | Actions |
| Mouse | system_click, system_double_click, system_right_click, mouse_click, mouse_move, system_hover, system_mouse_down, system_mouse_up, system_drag, scroll, human_pause |
| Keyboard | paste_text, system_type, send_key |
| Keyboard shortcuts | One complete key map with no Super-key bindings: half and quarter tiling, maximize, fullscreen, minimize, close, focus by app, by number and by direction, terminal. desktop_keybindings lists it, and KEYBINDINGS_FILE replaces it |
| Accessibility tree | desktop_accessibility_tree, desktop_accessibility_find and desktop_accessibility_action read and act on controls an app exposes through AT-SPI2, like uiautomator |
Use it as it is for Linux desktop automation, or build your own image on it: a plugin adds actions for the software you install, such as a browser.
## Contents
Quick start
How it works
What it can do
Agent integrations
Script mode
Building on it
Configuration and security
Documentation
Development
Sponsor
License
## Quick start
bash
docker run -d --name desk \
-p 127.0.0.1:8080:8080 \
-p 127.0.0.1:5900:5900 \
psyb0t/auto-linux-desk
Open http://localhost:5900/ to watch the screen. Port 8080 serves the HTTP API and the MCP endpoint at /mcp/.
bash
# Open a terminal with the window manager shortcut
curl -X POST http://localhost:8080 \
-H "Content-Type: application/json" \
-d '{
"action": "send_key",
"key": "ctrl+alt+t"
}'
# Type into it with human keystrokes
curl -X POST http://localhost:8080 \
-H "Content-Type: application/json" \
-d '{
"action": "system_type",
"text": "uname -a\n"
}'
# Or run a command directly
curl -X POST http://localhost:8080 \
-H "Content-Type: application/json" \
-d '{
"action": "run_command",
"command": "ls -la /userdata"
}'
# Look at the screen
curl "http://localhost:8080/screenshot/desktop?whLargest=512" -o desk.png
The example keeps both ports on loopback. Read configuration and security before making them reachable from another machine.
## How it works
One container owns one desktop. HTTP requests and MCP tools call the same action dispatcher; run_script keeps several steps under one request lock. The noVNC viewer shows the same screen the agent controls.
| Component | Purpose |
| Xvfb and Openbox | Virtual screen, windows, focus, tiling and keyboard shortcuts. |
| PyAutoGUI and XTest | OS-level mouse, keyboard and wheel input with humanized motion and timing. |
| D-Bus and AT-SPI2 | Read and act on widgets that desktop apps expose to accessibility clients. |
| HTTP API and MCP | Control the desktop on port 8080; MCP uses /mcp/. |
| x11vnc and noVNC | Watch and control the desktop in a browser on port 5900. |
| ffmpeg, scrot and xclip | MP4 recordings, PNG screenshots and the shared X11 clipboard. |
## What it can do
| Area | Actions |
| Mouse | system_click, system_double_click, system_right_click, mouse_click, mouse_move, system_hover, system_mouse_down, system_mouse_up, system_drag, scroll, human_pause |
| Keyboard | paste_text, system_type, send_key |
| Keyboard shortcuts | One complete key map with no Super-key bindings: half and quarter tiling, maximize, fullscreen, minimize, close, focus by app, by number and by direction, terminal. desktop_keybindings lists it, and KEYBINDINGS_FILE replaces it |
| Accessibility tree | desktop_accessibility_tree, desktop_accessibility_find and desktop_accessibility_action read and act on controls an app exposes through AT-SPI2, like uiautomator |
Listed badge (optional)
Copy this line into the README if you want the listing mark. Optional, and it does not affect being listed.
[](https://anclum.com/en/s/psyb0t-docker-auto-linux-desk/)
- Source
- github · https://github.com/psyb0t/docker-auto-linux-desk
- Browse by field
- Open source
- added
- today
More entries
Filed under
Every tag opens the full list for that filter. Counts are the live catalogue figures.