← Back to Skills Marketplace
Run Test Plan
by
Kevin Anderson
· GitHub ↗
· v1.0.1
· MIT-0
98
Downloads
0
Stars
1
Active Installs
2
Versions
Install in OpenClaw
/install run-test-plan
Description
Execute YAML test plan, stop on first failure, output rich debug prompt
Usage Guidance
This skill is a legitimate test-runner but can execute any shell command embedded in the YAML plan and will import environment variables from the running environment. Before using it: (1) review the test plan file yourself for any dangerous commands or network calls; (2) run it in an isolated environment or CI runner that has no sensitive credentials or secrets mounted; (3) remove or sanitize any environment variables you don't want exposed (DATABASE_URL, AWS_*, SSH keys, etc.); (4) prefer running only plans from trusted sources; and (5) if you must run untrusted plans, restrict network access and filesystem permissions for the runner process.
Capability Assessment
Purpose & Capability
Name and description match the instructions: the SKILL.md describes parsing a YAML test plan, running setup, health checks, and sequential tests (shell, curl, agent-browser). The agent-browser dependency and use of curl, nohup, and file-based evidence/pid logs are expected for a test runner.
Instruction Scope
The instructions tell the agent to execute arbitrary shell commands taken directly from the YAML plan and to export environment values resolved from the current environment. There is no explicit restriction or sanitization of those commands or network endpoints. The skill also writes logs/pids to .beagle/ and evidence to docs/testing/evidence/. Executing arbitrary commands from an untrusted plan can run anything on the host.
Install Mechanism
Instruction-only skill with no install spec and no code files — nothing will be downloaded or written by an installer. This minimizes install-time risk.
Credentials
The skill explicitly resolves ${VAR} references from the current environment when exporting setup.env values but declares no required environment variables. That mismatch means it will read whatever env vars are present (including secrets like DATABASE_URL, AWS_*, etc.) without documenting them. Tests run by the plan could also access files or network resources and thereby exfiltrate secrets.
Persistence & Privilege
always is false and disable-model-invocation is true (it cannot autonomously call the model). The skill only writes service logs/pids and evidence under repository-style paths (.beagle/, docs/testing/evidence/) and does not attempt to change other skills or global agent settings.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install run-test-plan - After installation, invoke the skill by name or use
/run-test-plan - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.1
**Added strict execution gates before running tests and evaluating results.**
- Verifies plan path, YAML validity, and evidence directory existence before starting tests.
- After setup (or with `--skip-setup`), checks that all required health checks/services are alive before any test runs.
- Adds validation that all artifacts from test steps (output, status, snapshots, evidence files) exist before pass/fail logic.
- Clarifies gate criteria for both legacy and modern setup formats.
- No functional changes to test execution, but reduces chances of tests running with missing prerequisites or incomplete state.
v1.0.0
Initial release of the run-test-plan skill.
- Executes a YAML-defined test plan: setup, health checks, and tests run sequentially.
- Stops on the first test failure and generates a detailed debug report with evidence and suggestions.
- Supports CLI, database, curl, and browser-agent test steps.
- Handles legacy and modern test plan formats.
- Outputs a summary test results table and preserves evidence for failures.
- Requires agent-browser skill for browser automation tests.
Metadata
Frequently Asked Questions
What is Run Test Plan?
Execute YAML test plan, stop on first failure, output rich debug prompt. It is an AI Agent Skill for Claude Code / OpenClaw, with 98 downloads so far.
How do I install Run Test Plan?
Run "/install run-test-plan" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Run Test Plan free?
Yes, Run Test Plan is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does Run Test Plan support?
Run Test Plan is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Run Test Plan?
It is built and maintained by Kevin Anderson (@anderskev); the current version is v1.0.1.
More Skills