← Back to Skills Marketplace
1615
Downloads
3
Stars
1
Active Installs
1
Versions
Install in OpenClaw
/install singleshot-prompt-testing
Description
Test and optimize prompts for cost, token use, and performance with detailed reports using single shot queries across multiple providers and models.
Usage Guidance
This skill appears coherent and implements what it says: a wrapper/workflow for a third-party singleshot CLI that measures tokens, costs, and latency. Before installing or running the CLI yourself: 1) Inspect the upstream repository (https://github.com/vincentzhangz/singleshot) and the Homebrew tap to confirm code provenance; 2) Only provide API keys for providers you trust, and avoid setting OPENAI_BASE_URL or other custom endpoints to unknown servers (they could receive your requests and keys); 3) Prefer using local/no-key options (e.g., Ollama) for early testing; 4) Consider using scoped or short-lived keys if supported, and do not paste keys into public files. If you want a deeper review, provide the upstream repo or the installed binary source and I can look for network calls, telemetry, or unexpected behavior.
Capability Analysis
Type: OpenClaw Skill
Name: singleshot-prompt-testing
Version: 0.1.0
The skill bundle provides instructions for installing and using the `singleshot` CLI tool for prompt testing and optimization. All commands and documentation across `SKILL.md`, `README.md`, `QUICKSTART.md`, and `metadata.json` are consistent with this stated purpose. There is no evidence of data exfiltration, malicious execution, persistence mechanisms, obfuscation, or prompt injection attempts against the OpenClaw agent. The use of API keys is for the tool's functionality, and file/network access is necessary for generating and analyzing prompt reports.
Capability Assessment
Purpose & Capability
The skill is named and documented as a prompt cost/testing/optimization helper and all instructions show usage of a singleshot CLI for generating token/cost reports. The declared requirements (API keys for providers) match the described multi-provider testing capability and nothing extraneous (e.g., cloud admin creds) is requested.
Instruction Scope
SKILL.md instructs the agent to run the singleshot CLI, generate reports, cat/grep/diff report files, and optionally point the CLI at providers via environment variables. These actions are within the stated purpose. One noteworthy point: the documentation allows configuring OPENAI_BASE_URL (a custom endpoint) and other provider endpoints which can redirect model requests to arbitrary servers—this is a normal feature for alternate endpoints but increases risk if you point keys to untrusted endpoints.
Install Mechanism
The published skill is instruction-only and contains no automated install spec. The docs recommend installing a third-party CLI via Homebrew tap (vincentzhangz/singleshot) or cargo. That is consistent with a CLI-based skill; however, installing from a third-party tap or crate is an explicit user action and you should audit the upstream repo before installing.
Credentials
The skill recommends supplying provider API keys (OPENAI_API_KEY, ANTHROPIC_API_KEY, OPENROUTER_API_KEY) which are directly relevant to calling model providers. No unrelated secrets or system credentials are requested. Caution: OPENAI_BASE_URL and similar endpoint variables can be used to route requests (and therefore your keys/data) to nonstandard endpoints—only set them to trusted URLs.
Persistence & Privilege
The skill does not request always:true and is user-invocable only. It is instruction-only and does not install persistent hooks or modify other skills or global agent settings. It therefore requests no elevated persistence or privileges.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install singleshot-prompt-testing - After installation, invoke the skill by name or use
/singleshot-prompt-testing - Provide required inputs per the skill's parameter spec and get structured output
Version History
v0.1.0
Singleshot Prompt Testing & Optimization Skill v0.1.0
- Initial release of Singleshot Prompt Testing & Optimization Skill.
- Provides detailed guidance for prompt cost and token efficiency testing before production.
- Includes example commands for benchmarking and comparing AI model costs, performance, and output.
- Documents workflow for generating, optimizing, and comparing prompt reports.
- Offers best practices, troubleshooting tips, and environment variable setup for common AI providers.
Metadata
Frequently Asked Questions
What is Singleshot Prompt Testing?
Test and optimize prompts for cost, token use, and performance with detailed reports using single shot queries across multiple providers and models. It is an AI Agent Skill for Claude Code / OpenClaw, with 1615 downloads so far.
How do I install Singleshot Prompt Testing?
Run "/install singleshot-prompt-testing" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Singleshot Prompt Testing free?
Yes, Singleshot Prompt Testing is completely free (open-source). You can download, install and use it at no cost.
Which platforms does Singleshot Prompt Testing support?
Singleshot Prompt Testing is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Singleshot Prompt Testing?
It is built and maintained by Vincent (@vincentzhangz); the current version is v0.1.0.
More Skills