← Back to Skills Marketplace
stonechen1014

Skill Eval Preflight

by Stone Chen · GitHub ↗ · v1.0.0 · MIT-0
cross-platform ✓ Security Clean
216
Downloads
1
Stars
0
Active Installs
1
Versions
Install in OpenClaw
/install skill-eval-preflight
Description
Validate OpenClaw skills during authoring. Use when creating, revising, or preparing a skill for release and you need to scaffold `evals/` files, check readi...
Usage Guidance
This skill appears coherent and appropriate for authors: it reads SKILL.md and evals/ files and creates eval scaffolding and run artifacts under the target skill directory. Before installing or running: (1) review the included Python scripts yourself (they are small and local) to confirm you trust operations that read/write files in the target directory; (2) run the tools on a copy or a non-production repo if you want to avoid creating run folders in-place; (3) note the scripts do not perform network calls or require credentials, so there is low risk of secret exfiltration. If you need the agent to run this autonomously, remember autonomous invocation is allowed by default—only enable that if you trust the skill and its inputs.
Capability Analysis
Type: OpenClaw Skill Name: skill-eval-preflight Version: 1.0.0 The skill bundle is a developer utility for scaffolding and validating OpenClaw skill metadata and evaluation files. The Python scripts (e.g., check_eval_readiness.py, run_eval.py, init_eval.py) perform standard file I/O, JSON parsing, and string validation to identify placeholder content and ensure proper directory structure. There is no evidence of malicious intent, network activity, shell execution, or data exfiltration; the code uses only standard libraries and follows the stated purpose of providing an authoring-side preflight check.
Capability Assessment
Purpose & Capability
The name/description match the included scripts and files. The scripts only operate on a target skill directory (SKILL.md, evals/*.json, run outputs). No unrelated environment variables, binaries, or external services are required.
Instruction Scope
SKILL.md instructs running local Python scripts that validate/initialize eval files and generate static run artifacts. The scripts read and write files within the provided skill directory (SKILL.md, evals/, runs/). They do not access system credentials, home-wide config, or external endpoints.
Install Mechanism
No install spec or remote downloads are present; this is an instruction-only skill with included Python scripts. Nothing is pulled from external URLs or package registries during install.
Credentials
The skill requests no environment variables, credentials, or config paths. The scripts only use file-system access to the provided skill directory, which is appropriate for the stated purpose.
Persistence & Privilege
The skill is not always-enabled and is user-invocable. It writes output under evals/runs/<run-group>/<mode> and comparison artifacts under the run-group—this is expected behavior for an evaluator and does not modify other skills or system-wide settings.
How to Use
  1. Make sure OpenClaw is installed (local or Docker)
  2. Run the install command in chat: /install skill-eval-preflight
  3. After installation, invoke the skill by name or use /skill-eval-preflight
  4. Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
Version 1.0.0 Initial release of skill-eval-preflight. A lightweight authoring-side preflight for OpenClaw skills before deeper evaluation. This release includes: scaffolding for evals/ files readiness checks for a first evaluation pass review of positive and negative trigger coverage validation of eval prompts and expected artifacts static with-skill / without-skill comparison outputs detection of missing, empty, or unfinished eval scaffolding Current scope: focuses on authoring-side validation and release readiness does not perform live runtime evaluation or output quality scoring
Metadata
Slug skill-eval-preflight
Version 1.0.0
License MIT-0
All-time Installs 0
Active Installs 0
Total Versions 1
Frequently Asked Questions

What is Skill Eval Preflight?

Validate OpenClaw skills during authoring. Use when creating, revising, or preparing a skill for release and you need to scaffold `evals/` files, check readi... It is an AI Agent Skill for Claude Code / OpenClaw, with 216 downloads so far.

How do I install Skill Eval Preflight?

Run "/install skill-eval-preflight" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.

Is Skill Eval Preflight free?

Yes, Skill Eval Preflight is completely free, licensed under MIT-0. You can download, install and use it at no cost.

Which platforms does Skill Eval Preflight support?

Skill Eval Preflight is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).

Who created Skill Eval Preflight?

It is built and maintained by Stone Chen (@stonechen1014); the current version is v1.0.0.

💬 Comments