← Back to Skills Marketplace
prompt-ab-lab
by
vx：17605205782
· GitHub ↗
· v1.0.0
· MIT-0
259
Downloads
0
Stars
0
Active Installs
1
Versions
Install in OpenClaw
/install prompt-ab-lab
Description
Design, log, compare, and score prompt experiments so users can systematically improve outputs instead of guessing.
Usage Guidance
This skill appears low-risk and internally consistent. Before installing or invoking: (1) confirm python3 is on PATH; (2) review scripts/prompt_experiment_logger.py (it's small and local) and run it manually on a sample JSON to see outputs; (3) when using the skill in an agent session, be conscious that the agent could run the local script and write files to the working directory—only allow that if you trust the session context; (4) if you need network isolation, ensure the agent runtime does not have outbound network access (the skill itself does not require it).
Capability Analysis
Type: OpenClaw Skill
Name: prompt-ab-lab
Version: 1.0.0
The prompt-ab-lab skill is a well-documented tool for designing and logging prompt A/B experiments. It includes a simple, transparent Python script (scripts/prompt_experiment_logger.py) for generating CSV templates and a markdown resource (resources/eval_rubric.md) for evaluation criteria. The instructions in SKILL.md and README.md emphasize local execution, user confirmation, and safety, with no evidence of data exfiltration, obfuscation, or malicious intent.
Capability Assessment
Purpose & Capability
Name/description match the delivered assets: an instruction-only skill plus a small Python helper to generate CSV logs. Declared runtime dependency python3 is appropriate and sufficient for the bundled script.
Instruction Scope
SKILL.md confines actions to designing experiments, generating rubrics, and optionally using the local script and resource file. It does not instruct reading unrelated system files, accessing hidden env vars, or sending data to external endpoints.
Install Mechanism
No install spec is present (instruction-only). The only code is a small, local, readable Python script; there are no remote downloads, package installs, or extraction steps.
Credentials
No environment variables, credentials, or config paths are required. The skill's functionality does not demand any secrets or external service access.
Persistence & Privilege
always:false (default) and no post-install actions or modifications to other skills are present. The skill does not request elevated or persistent platform privileges.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install prompt-ab-lab - After installation, invoke the skill by name or use
/prompt-ab-lab - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
New version adds systematic prompt experiment design and logging features.
- Enables users to design, log, compare, and score prompt A/B experiments.
- Provides evaluation rubrics, structured test tables, and weighted scoring.
- Summarizes tradeoffs and suggests next steps rather than declaring outright winners.
- Includes clear workflow, operating rules, and usage boundaries for safer, action-oriented experimentation.
- Bundles a helper script and resource file to assist with experiment setup and evaluation.
Metadata
Frequently Asked Questions
What is prompt-ab-lab?
Design, log, compare, and score prompt experiments so users can systematically improve outputs instead of guessing. It is an AI Agent Skill for Claude Code / OpenClaw, with 259 downloads so far.
How do I install prompt-ab-lab?
Run "/install prompt-ab-lab" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is prompt-ab-lab free?
Yes, prompt-ab-lab is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does prompt-ab-lab support?
prompt-ab-lab is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created prompt-ab-lab?
It is built and maintained by vx：17605205782 (@52yuanchangxing); the current version is v1.0.0.
More Skills