/install application-use
macOS Desktop Automation (application-use)
A CLI to automate macOS applications.
install
npm i -g application-use
🚀 Core Workflow
- Open:
application-use open --appName "\x3CName>"-- Auto-shows initial snapshot. - Interact: Use hints (e.g.,
[A]) to click, type, or scroll. - Auto-Update: Commands (
open,click,type,sendkey,scroll) automatically display an updated snapshot.
[!TIP] Use
application-use snapshotonly when you need a fresh view without any action (e.g., after waiting for dynamic content).
🛠 Command Reference
| Command | Usage | Description |
|---|---|---|
open |
open --appName "Safari" |
Opens app and shows snapshot. |
click |
click A [--right] [--double] |
Clicks element by hint letter. |
fill |
fill A "text" or fill "text" |
Fills text into hint or focused element. |
sendkey |
sendkey enter, sendkey cmd+v |
Sends single or shortcut keys. |
scroll |
scroll "Main" down [500] |
Scrolls area by name/hint. |
screenshot |
screenshot [path] [--frame] |
Captures window or specific coordinates. |
search |
search "Safari" |
Finds installed application names. |
close |
close --appName "Safari" |
Quits the specified application. |
type |
type "text" |
Types text into the focused element. |
🏷 Hint System
- Elements:
[A],[B],[AA]... (Interactive elements). - Areas:
[a],[b]... (Targets for scrolling). - Special Marks:
(*)= OCR-detected;(+)= Newly added since last snapshot.
⚡️ Common Automation Patterns
Form Filling & Submission & scroll
application-use open --appName "Safari"
application-use fill A "[email protected]" # Fill email
application-use sendkey tab # Next field
application-use fill "password" # Focus-fill password
application-use sendkey enter # Submit
application-use scroll d down 1000 # Scroll down area d
Browser Navigation
application-use open --appName "Safari"
application-use fill A "https://google.com" && application-use sendkey enter
# Wait for load, then interact with hints from auto-snapshot
File Operations (Finder)
application-use open --appName "Finder"
application-use sendkey cmd+shift+g # Go to Folder
application-use fill "/Users/name/Downloads" && application-use sendkey enter
# Open in New Tab via right-click
application-use click A --right # Right-click folder/file (hint A)
application-use click B # Click "Open in New Tab" from menu (hint B)
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install application-use - After installation, invoke the skill by name or use
/application-use - Provide required inputs per the skill's parameter spec and get structured output
What is application-use?
Automate macOS tasks by opening apps, clicking elements, filling forms, typing, scrolling, and controlling the desktop via CLI commands. It is an AI Agent Skill for Claude Code / OpenClaw, with 93 downloads so far.
How do I install application-use?
Run "/install application-use" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is application-use free?
Yes, application-use is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does application-use support?
application-use is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created application-use?
It is built and maintained by Wei Qiang (@qdore); the current version is v1.0.0.