← Back to Skills Marketplace
Model Benchmark
by
leosheep821-debug
· GitHub ↗
· v0.1.0
· MIT-0
131
Downloads
0
Stars
0
Active Installs
1
Versions
Install in OpenClaw
/install model-benchmark
Description
深度测评各模型在 OpenClaw 上的实际表现,支持中文理解/代码/推理/工具调用多维度评估。
Usage Guidance
This skill appears to be a legitimate benchmarking instruction set, but it refers to obtaining and using multiple external provider API keys without declaring them in the metadata or describing how to provide or store them. Before installing or using it: (1) Confirm how you'll supply provider keys — prefer ephemeral or least-privilege keys and avoid pasting long-lived secrets into third-party UIs. (2) Understand where keys will be stored (models.json) and check file permissions; back up the original config. (3) Verify the local proxy address (127.0.0.1:8766) is expected in your environment and not a misdirection to an unfamiliar service. (4) If the agent will be given keys, ensure the agent's prompts/storage behavior is acceptable (won't exfiltrate them). If you need complete assurance, request the skill author to declare required env vars and document exactly how credentials are used and persisted.
Capability Analysis
Type: OpenClaw Skill
Name: model-benchmark
Version: 0.1.0
The skill bundle is a benchmarking framework designed to evaluate AI models on the OpenClaw platform across dimensions like code generation, reasoning, and tool use. The files (SKILL.md and skill.md) contain only descriptive instructions, test cases, and reporting templates without any executable code, data exfiltration logic, or malicious prompt injections. It correctly directs the user to configure API keys through the platform's standard 'models.json' configuration.
Capability Assessment
Purpose & Capability
The name, description, and SKILL.md consistently describe a model benchmarking framework and include sensible test cases and report format. The SKILL.md also legitimately references adding providers to OpenClaw's models.json and using provider API keys for GLM-5, Qwen, etc., which is expected for a benchmarking skill that talks to external models.
Instruction Scope
The instructions stay within benchmarking scope (test items, scoring, report format). They reference specific operational items: editing OpenClaw models.json to add providers, using a local proxy at 127.0.0.1:8766, and acquiring provider API keys. They do not instruct the agent to read unrelated system files or exfiltrate data, but they do not specify safe handling or storage of credentials.
Install Mechanism
No install spec and no code files are provided (instruction-only), so nothing will be written to disk or installed by the skill itself. This is the lowest-risk install model.
Credentials
The SKILL.md explicitly lists provider API Key needs (GLM-5, Qwen, etc.) but the skill metadata declares no required environment variables or primary credential. That mismatch means the skill may expect the user/agent to supply secrets via models.json or prompts at runtime; the skill gives no guidance on where keys are stored, what permissions are needed, or whether keys will be transmitted to other endpoints. Requiring multiple external API keys is proportionate to benchmarking, but the lack of declared/env guidance and storage instructions is a privacy/operational concern.
Persistence & Privilege
The skill is not always-included and does not request system-level persistence. It does mention editing OpenClaw configuration (models.json) which is a normal and limited config change for integrating providers; there is no indication it modifies other skills or system-wide settings beyond provider config advice.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install model-benchmark - After installation, invoke the skill by name or use
/model-benchmark - Provide required inputs per the skill's parameter spec and get structured output
Version History
v0.1.0
- Initial release of model-benchmark skill for deep evaluation of models on OpenClaw.
- Supports multidimensional assessment: Chinese understanding, coding, reasoning, and tool-use evaluation.
- Includes a standardized test set and scoring rubrics for consistent benchmarking.
- Documents required APIs and configuration methods for adding new model providers.
- Provides a detailed report template for presenting model evaluation results.
Metadata
Frequently Asked Questions
What is Model Benchmark?
深度测评各模型在 OpenClaw 上的实际表现,支持中文理解/代码/推理/工具调用多维度评估。 It is an AI Agent Skill for Claude Code / OpenClaw, with 131 downloads so far.
How do I install Model Benchmark?
Run "/install model-benchmark" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Model Benchmark free?
Yes, Model Benchmark is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does Model Benchmark support?
Model Benchmark is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Model Benchmark?
It is built and maintained by leosheep821-debug (@leosheep821-debug); the current version is v0.1.0.
More Skills