← Back to Skills Marketplace
Linux GUI Control
by
dreamtraveler13
· GitHub ↗
· v1.0.0
12256
Downloads
8
Stars
0
Active Installs
1
Versions
Install in OpenClaw
/install guicountrol
Description
Control the Linux desktop GUI using xdotool, wmctrl, and dogtail. Use when you need to interact with non-browser applications, simulate mouse/keyboard input, manage windows, or inspect the UI hierarchy of applications on X11/GNOME. Supports: (1) Clicking/typing in apps, (2) Resizing/moving windows, (3) Extracting text-based UI trees from apps (A11y), (4) Taking screenshots for visual analysis.
Usage Guidance
Install only if you intentionally want an agent to operate your local Linux desktop. Before use, close or hide sensitive windows, verify the active target window, avoid visible passwords or private data during screenshots/UI inspection, and save work before any workflow that kills or restarts an application.
Capability Analysis
Type: OpenClaw Skill
Name: guicountrol
Version: 1.0.0
The skill bundle is classified as suspicious due to its powerful capabilities for Linux GUI control, including simulating mouse/keyboard input, managing windows, taking screenshots, and killing processes, as demonstrated by `xdotool`, `wmctrl`, `scrot`, `pkill`, and `dogtail` usage in `SKILL.md`, `scripts/gui_action.sh`, and `scripts/inspect_ui.py`. While these actions are plausibly aligned with the stated purpose of 'Linux GUI Control', they represent significant high-risk capabilities that could be misused if the agent's instructions or environment were compromised, even though no explicit malicious intent is present in the provided files.
Capability Assessment
Purpose & Capability
The skill’s stated purpose is Linux GUI automation, and the artifacts openly provide matching primitives: window listing/activation, mouse clicks, typing, keypresses, accessibility-tree inspection, screenshots, and an Electron accessibility relaunch example.
Instruction Scope
The instructions are broad enough to affect arbitrary desktop applications and include a pkill/relaunch workflow, but the actions are user-invoked examples rather than automatic hidden behavior.
Install Mechanism
No installer or dependency manifest is present; the skill assumes external Linux tools such as xdotool, wmctrl, dogtail, and scrot are available.
Credentials
Full-desktop screenshots and accessibility inspection can expose sensitive on-screen information, but that access is inherent to the disclosed GUI-control purpose and no upload, network transfer, or unrelated data collection appears in the artifacts.
Persistence & Privilege
The reviewed files show no persistence, privilege escalation, credential-store access, background worker, obfuscation, self-modification, or exfiltration path.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install guicountrol - After installation, invoke the skill by name or use
/guicountrol - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
linux-gui-control 1.0.0 initial release
- Automate Linux desktop interactions using xdotool, wmctrl, and dogtail.
- Supports simulating mouse/keyboard input, window management, and text-based UI inspection on X11/GNOME.
- Offers scripts for automating clicks, typing, window focus, and window movement.
- Enables extraction of application UI hierarchies for accessible apps and provides screenshot support for visual tasks.
Metadata
Frequently Asked Questions
What is Linux GUI Control?
Control the Linux desktop GUI using xdotool, wmctrl, and dogtail. Use when you need to interact with non-browser applications, simulate mouse/keyboard input, manage windows, or inspect the UI hierarchy of applications on X11/GNOME. Supports: (1) Clicking/typing in apps, (2) Resizing/moving windows, (3) Extracting text-based UI trees from apps (A11y), (4) Taking screenshots for visual analysis. It is an AI Agent Skill for Claude Code / OpenClaw, with 12256 downloads so far.
How do I install Linux GUI Control?
Run "/install guicountrol" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Linux GUI Control free?
Yes, Linux GUI Control is completely free (open-source). You can download, install and use it at no cost.
Which platforms does Linux GUI Control support?
Linux GUI Control is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Linux GUI Control?
It is built and maintained by dreamtraveler13 (@dreamtraveler13); the current version is v1.0.0.
More Skills