← Back to Skills Marketplace
skill-creator
by
Shimmernight
· GitHub ↗
· v2.0.0
· MIT-0
401
Downloads
0
Stars
11
Active Installs
1
Versions
Install in OpenClaw
/install skill-creator-latest
Description
Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, update or optimize...
Usage Guidance
This package largely does what it says — it helps author and evaluate skills — but it omits a few important operational details. Before installing or running anything: 1) Review the code yourself (especially scripts that write files or call subprocesses). 2) Expect to need Python dependencies (anthropic, pyyaml, etc.) and a local 'claude' CLI; don't run arbitrary pip installs without checking package sources. 3) Do not supply API keys (Anthropic or others) to this skill unless you trust the code and intend it to call remote models; the code will call external model APIs which will transmit prompt/eval data. 4) Run in an isolated environment (container/VM) or a project workspace where writing to .claude/commands and creating zip files is safe. 5) If you want to proceed, add explicit metadata: required binaries and env vars (e.g., ANTHROPIC_API_KEY, presence of 'claude' CLI) and/or modify scripts to surface prompts before network calls. These steps will reduce unexpected behavior and data exposure.
Capability Analysis
Type: OpenClaw Skill
Name: skill-creator-latest
Version: 2.0.0
The bundle is a comprehensive developer toolset designed to facilitate the creation, testing, and optimization of other OpenClaw skills. It contains scripts for running evaluations via the Claude CLI (run_eval.py), aggregating performance metrics (aggregate_benchmark.py), and generating local HTML reports (generate_report.py). A local HTTP server is implemented in generate_review.py to allow users to review test results and provide feedback. While the bundle performs high-privilege actions such as executing subprocesses and managing local files/ports, these behaviors are strictly aligned with its stated purpose as a meta-development tool. No evidence of data exfiltration, malicious prompt injection, or unauthorized persistence was found.
Capability Assessment
Purpose & Capability
The name and description (create/modify/evaluate skills) align with the included scripts: packaging, validation, running trigger evaluations, aggregating benchmarks, and improving descriptions. However, the skill metadata declares no required binaries or environment variables while the code expects a 'claude' CLI (invoked via subprocess) and the anthropic Python client — a declared dependency and credentials are missing from the metadata. This mismatch is a design/packaging omission and reduces transparency.
Instruction Scope
SKILL.md describes the iterative workflow and evaluation loop which matches the scripts. The runtime behavior (as implemented) will: write temporary command files into a .claude/commands directory, spawn subprocesses that run the 'claude' CLI, call the Anthropics API via the anthropic client, and read/write project files (packaging, generating viewer HTML, logs). Those actions are within the stated purpose but SKILL.md does not explicitly warn that it will execute local binaries, create and delete files in the project tree, or call external model APIs — an important gap for users.
Install Mechanism
This is instruction-only (no install spec), but many Python scripts require third-party packages (e.g., anthropic, pyyaml) and a local 'claude' CLI binary. Because there is no declared install step or dependency list, a user might run scripts without needed packages or unknowingly install dependencies. Lack of an explicit install mechanism increases the chance of unexpected package installs or runtime failures.
Credentials
Registry metadata declares no required env vars or primary credential, yet the code instantiates anthropic.Anthropic() (which typically requires an API key via env vars) and spawns a 'claude' subprocess that depends on a CLI/runtime with its own authentication. The scripts also read and modify os.environ (they explicitly remove CLAUDECODE in one place). Asking for no credentials while using remote model clients and a local model CLI is a clear inconsistency and warrants caution.
Persistence & Privilege
always:false and user-invocable:true (normal). The scripts create and remove files under a project-level .claude/commands directory and write packaged .skill zip files and logs. They do not request permanent agent-level privileges, nor do they set always:true. Still, they modify the filesystem (creating command files that could cause the local 'claude' binary to see new commands), so review/consent is recommended before running.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install skill-creator-latest - After installation, invoke the skill by name or use
/skill-creator-latest - Provide required inputs per the skill's parameter spec and get structured output
Version History
v2.0.0
Major update with new evaluation, iteration, and optimization features.
- Added scripts and agents for benchmarking, grading, comparing, and reviewing skill performance (quantitative + qualitative evaluation workflow).
- Expanded bundled resources: new scripts, reference schemas, HTML assets, and utilities for running and aggregating skill evaluations.
- Updated guidance: covers not just creating and updating skills, but also running evals, analyzing results, and optimizing skill descriptions for better triggering accuracy.
- Simplified and streamlined instructions to better support iterative skill improvement and user communication at varying technical levels.
- Removed redundant or now-integrated reference and initialization files.
Metadata
Frequently Asked Questions
What is skill-creator?
Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, update or optimize... It is an AI Agent Skill for Claude Code / OpenClaw, with 401 downloads so far.
How do I install skill-creator?
Run "/install skill-creator-latest" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is skill-creator free?
Yes, skill-creator is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does skill-creator support?
skill-creator is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created skill-creator?
It is built and maintained by Shimmernight (@shimmernight); the current version is v2.0.0.
More Skills