← Back to Skills Marketplace
269
Downloads
0
Stars
0
Active Installs
1
Versions
Install in OpenClaw
/install midscene-harmony-automation
Description
Vision-driven HarmonyOS NEXT device automation using Midscene. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact wit...
Usage Guidance
This skill will take screenshots of your HarmonyOS device and send them to whatever model endpoint you configure (MIDSCENE_MODEL_BASE_URL), and it runs code via 'npx @midscene/harmony@1' (dynamic npm download). Before installing or running it: 1) Verify the npm package origin and review its source (look up @midscene/harmony on the npm registry or the project's repository) rather than blindly running npx. 2) Be cautious about model API keys — only provide keys with least privilege and avoid pasting long-lived cloud credentials into a .env unless you trust the package. 3) Understand that screenshots may contain sensitive data (passwords, 2FA codes, personal info) and will likely be uploaded to external providers for inference; avoid automating flows that show sensitive content or use an isolated account/environment. 4) Confirm HDC is installed locally (the skill requires it despite metadata saying none). 5) Ask the publisher to correct the registry metadata to list required env vars and binaries; metadata mismatches are a red flag. If you cannot verify package provenance and privacy behavior, prefer not to run this skill on sensitive devices.
Capability Analysis
Type: OpenClaw Skill
Name: midscene-harmony-automation
Version: 1.0.3
The skill provides a legitimate automation interface for HarmonyOS NEXT devices using the Midscene.js framework and the standard HarmonyOS Device Connector (HDC). It operates by executing 'npx @midscene/harmony@1' commands via Bash to perform UI interactions based on visual analysis, requiring user-configured LLM API keys for processing. No evidence of malicious intent, data exfiltration, or unauthorized persistence was found in SKILL.md or _meta.json.
Capability Assessment
Purpose & Capability
The stated purpose—vision-driven HarmonyOS automation via Midscene—is coherent with the SKILL.md (commands to connect, take screenshots, and run 'act'). However the registry metadata claims no required env vars or binaries while the SKILL.md requires HDC and multiple MIDSCENE_* environment variables (model API keys and endpoints). This metadata mismatch is unexpected and reduces trust.
Instruction Scope
Instructions explicitly require taking screenshots and using Midscene which will perform model inference against configured MIDSCENE_MODEL_BASE_URL endpoints. That implies image uploads (potentially including sensitive screen contents) to third-party model providers. The SKILL.md does not provide privacy or minimization guidance. It also instructs the agent to read saved screenshot files; that is within scope, but the external-network/telemetry implications are not called out.
Install Mechanism
There is no install spec, but the runtime instructions rely on 'npx @midscene/harmony@1', which will dynamically download and execute code from the npm registry at runtime. Dynamic npx installs are effectively remote code execution and should be considered higher risk unless the package provenance is verified. No explicit trusted source (e.g., GitHub repo, homepage) is provided — the SKILL.md links midscenejs.com but registry metadata lists no homepage.
Credentials
SKILL.md requires multiple environment variables: MIDSCENE_MODEL_API_KEY, MIDSCENE_MODEL_NAME, MIDSCENE_MODEL_BASE_URL, MIDSCENE_MODEL_FAMILY (and optional others). The registry metadata declared no required env vars. Requiring model API keys is reasonable for a tool that calls external models, but it is disproportionate for a simple local device automation skill if those keys are broad cloud credentials. The instructions provide examples for several providers, which could encourage pasting sensitive keys into a .env without warning.
Persistence & Privilege
The skill is not always-enabled and doesn't request system-wide config changes or cross-skill privileges. It suggests creating a .env in the working directory, which is normal. Autonomous invocation is allowed (platform default) and not combined with other high privileges here.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install midscene-harmony-automation - After installation, invoke the skill by name or use
/midscene-harmony-automation - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.3
Initial release of vision-driven HarmonyOS device automation powered by Midscene.
- Automate HarmonyOS NEXT devices via natural language commands with no DOM or accessibility labels required—works from screenshots only.
- Supports taps, swipes, text input, app launches, screenshots, and more by describing actions in plain language.
- Clear instructions and rules for reliable, synchronous operation using Midscene CLI and HDC tool.
- Detailed configuration guidance for supported AI models and HDC device connectivity.
- Workflow patterns and best practices provided for efficient, robust automation including app foregrounding and summarizing report files.
- Troubleshooting and app bundle name references included for quick setup and usage.
Metadata
Frequently Asked Questions
What is Midscene Automations Skills for HarmonyOS?
Vision-driven HarmonyOS NEXT device automation using Midscene. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact wit... It is an AI Agent Skill for Claude Code / OpenClaw, with 269 downloads so far.
How do I install Midscene Automations Skills for HarmonyOS?
Run "/install midscene-harmony-automation" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Midscene Automations Skills for HarmonyOS free?
Yes, Midscene Automations Skills for HarmonyOS is completely free (open-source). You can download, install and use it at no cost.
Which platforms does Midscene Automations Skills for HarmonyOS support?
Midscene Automations Skills for HarmonyOS is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Midscene Automations Skills for HarmonyOS?
It is built and maintained by Leyang (@quanru); the current version is v1.0.3.
More Skills