← Back to Skills Marketplace
Linux GUI Control
by
dreamtraveler13
· GitHub ↗
· v1.0.0
11500
Downloads
8
Stars
29
Active Installs
1
Versions
Install in OpenClaw
/install guicountrol
Description
Control the Linux desktop GUI using xdotool, wmctrl, and dogtail. Use when you need to interact with non-browser applications, simulate mouse/keyboard input, manage windows, or inspect the UI hierarchy of applications on X11/GNOME. Supports: (1) Clicking/typing in apps, (2) Resizing/moving windows, (3) Extracting text-based UI trees from apps (A11y), (4) Taking screenshots for visual analysis.
Usage Guidance
Install only if you want an agent to control your local Linux desktop. Before using it, close or hide unrelated sensitive windows, confirm the target window, avoid visible passwords or private data during screenshots/UI inspection, and be careful with commands that type text, press keys, or restart applications.
Capability Analysis
Type: OpenClaw Skill
Name: guicountrol
Version: 1.0.0
The skill bundle is classified as suspicious due to its powerful capabilities for Linux GUI control, including simulating mouse/keyboard input, managing windows, taking screenshots, and killing processes, as demonstrated by `xdotool`, `wmctrl`, `scrot`, `pkill`, and `dogtail` usage in `SKILL.md`, `scripts/gui_action.sh`, and `scripts/inspect_ui.py`. While these actions are plausibly aligned with the stated purpose of 'Linux GUI Control', they represent significant high-risk capabilities that could be misused if the agent's instructions or environment were compromised, even though no explicit malicious intent is present in the provided files.
Capability Assessment
Purpose & Capability
The skill openly provides GUI control through xdotool, wmctrl, dogtail, and scrot for clicking, typing, window activation, UI inspection, and screenshots; these are powerful but directly aligned with the Linux GUI control purpose.
Instruction Scope
Instructions expose broad desktop primitives and include a pkill/nohup example for relaunching apps with accessibility enabled, so users need to confirm the target window and save work before use. The artifacts do not show automatic or hidden execution.
Install Mechanism
There is no installer or dependency manifest, while the skill depends on external OS tools such as xdotool, wmctrl, dogtail, and scrot. This is an under-declared dependency issue, not evidence of malicious behavior.
Credentials
Full-desktop screenshots and accessibility-tree inspection can reveal sensitive on-screen text, but that access is inherent to the stated GUI automation use case and there is no network transfer or unrelated data collection.
Persistence & Privilege
No persistence, privilege escalation, credential access, background worker, network exfiltration, or self-modifying behavior appears in the shipped files.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install guicountrol - After installation, invoke the skill by name or use
/guicountrol - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
linux-gui-control 1.0.0 initial release
- Automate Linux desktop interactions using xdotool, wmctrl, and dogtail.
- Supports simulating mouse/keyboard input, window management, and text-based UI inspection on X11/GNOME.
- Offers scripts for automating clicks, typing, window focus, and window movement.
- Enables extraction of application UI hierarchies for accessible apps and provides screenshot support for visual tasks.
Metadata
Frequently Asked Questions
What is Linux GUI Control?
Control the Linux desktop GUI using xdotool, wmctrl, and dogtail. Use when you need to interact with non-browser applications, simulate mouse/keyboard input, manage windows, or inspect the UI hierarchy of applications on X11/GNOME. Supports: (1) Clicking/typing in apps, (2) Resizing/moving windows, (3) Extracting text-based UI trees from apps (A11y), (4) Taking screenshots for visual analysis. It is an AI Agent Skill for Claude Code / OpenClaw, with 11500 downloads so far.
How do I install Linux GUI Control?
Run "/install guicountrol" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Linux GUI Control free?
Yes, Linux GUI Control is completely free (open-source). You can download, install and use it at no cost.
Which platforms does Linux GUI Control support?
Linux GUI Control is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Linux GUI Control?
It is built and maintained by dreamtraveler13 (@dreamtraveler13); the current version is v1.0.0.
More Skills