← Back to Skills Marketplace
xmanrui

Model Healthcheck

by xmanrui · GitHub ↗ · v1.0.0
cross-platform ⚠ suspicious
775
Downloads
0
Stars
9
Active Installs
1
Versions
Install in OpenClaw
/install model-healthcheck
Description
Test all configured models for availability. Activate when user says "test models", "check models", "model healthcheck", "测试模型", "测试所有模型", "检查模型", or "模型健康检查".
README (SKILL.md)

Model Healthcheck Skill

When the user requests a model test, follow these steps:

Steps

  1. Get all model list Use gateway config.get to read the current config and extract all provider/model combinations from models.providers.

  2. Test all models concurrently For each model, use sessions_spawn to run a test:

    • task: "Reply with exactly: model ok. Only reply these two words."
    • model: the corresponding provider/model-id
    • runTimeoutSeconds: 30
    • cleanup: "delete"

    Fire all tests concurrently (multiple sessions_spawn calls at once), do not test sequentially.

  3. Collect results and summarize Wait for all tests to complete, then summarize as a list:

    • provider/model-id — ✅ OK / ❌ Failed (Xs) — error message if any

    Fields:

    • Status: normal reply = ✅, timeout or error = ❌
    • Duration: time from spawn to result
    • Error: if failed, show the specific error (API error, timeout, auth failure, etc.)
  4. Output results Send the summary to the user, with a final tally:

    • Total models tested: X
    • Passed: X
    • Failed: X (list failed model names and reasons)

Notes

  • Skip the model currently in use (no need to test yourself)
  • If the user specifies a particular model, only test that one
  • Feishu/WhatsApp and similar platforms don't support markdown tables — use list format instead
Usage Guidance
This skill will read your agent's gateway config to find every configured provider/model and then spawn concurrent test sessions that use those providers' credentials. Before installing or running it, consider: (1) it may trigger real API calls that incur usage charges and hit provider rate limits; (2) it runs tests concurrently with no built-in throttling or confirmation; (3) it implicitly uses stored provider credentials though none are declared; (4) the SKILL.md doesn't ask the user to confirm testing all models or long-running batches. Recommended precautions: only run the skill on a subset of models first (or request the skill be modified to ask for confirmation), add concurrency limits or sequential mode, ensure you understand provider billing/quota, and verify you are comfortable the agent can read gateway config and use those credentials. If the author can provide an explicit note that the skill will use configured provider credentials and add safety controls (confirm, throttling, per-model testing), my confidence in its coherence would increase.
Capability Analysis
Type: OpenClaw Skill Name: model-healthcheck Version: 1.0.0 The skill bundle is designed for a model health check, utilizing internal OpenClaw APIs (`gateway config.get`, `sessions_spawn`) to retrieve model configurations and test their availability. All instructions in `SKILL.md` are directly aligned with the stated purpose, involving benign actions like spawning test sessions with a simple 'model ok' prompt, collecting results, and summarizing them. There is no evidence of malicious intent, data exfiltration, unauthorized command execution, persistence mechanisms, or harmful prompt injection attempts against the agent.
Capability Assessment
Purpose & Capability
The name/description (test all configured models) align with the instructions: read configured models and spawn short test sessions for each provider/model. The required resources (none declared) are plausible because the skill is instruction-only and uses the agent's gateway/config and session APIs.
Instruction Scope
The SKILL.md explicitly tells the agent to call 'gateway config.get' to enumerate models and to call 'sessions_spawn' concurrently for every model. Reading the agent gateway config and spawning authenticated sessions is within the nominal goal, but the instructions give broad discretion (concurrent, multi-spawn) and do not require user confirmation, rate-limiting, cost-awareness, or limits on concurrency. It also assumes access to provider credentials in the gateway config without documenting that fact.
Install Mechanism
No install spec and no code files — instruction-only. This has low install risk because nothing is downloaded or written to disk.
Credentials
The skill declares no required environment variables, but it instructs reading gateway config and using configured provider/model IDs. That implicitly uses whatever provider credentials are stored in the agent configuration. The implicit access to provider credentials (and the ability to cause API calls and potential charges) is not declared or explained, which is disproportionate to the 'no env needed' claim.
Persistence & Privilege
always is false and the skill is user-invocable. There is no install, no writes to other skills' configs, and no request for permanent presence. Normal invocation privileges only.
How to Use
  1. Make sure OpenClaw is installed (local or Docker)
  2. Run the install command in chat: /install model-healthcheck
  3. After installation, invoke the skill by name or use /model-healthcheck
  4. Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
Initial release: test all configured models concurrently
Metadata
Slug model-healthcheck
Version 1.0.0
License
All-time Installs 9
Active Installs 9
Total Versions 1
Frequently Asked Questions

What is Model Healthcheck?

Test all configured models for availability. Activate when user says "test models", "check models", "model healthcheck", "测试模型", "测试所有模型", "检查模型", or "模型健康检查". It is an AI Agent Skill for Claude Code / OpenClaw, with 775 downloads so far.

How do I install Model Healthcheck?

Run "/install model-healthcheck" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.

Is Model Healthcheck free?

Yes, Model Healthcheck is completely free (open-source). You can download, install and use it at no cost.

Which platforms does Model Healthcheck support?

Model Healthcheck is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).

Who created Model Healthcheck?

It is built and maintained by xmanrui (@xmanrui); the current version is v1.0.0.

💬 Comments