← Back to Skills Marketplace
Model Audit Pro
by
aiwithabidi
· GitHub ↗
· v1.0.0
567
Downloads
0
Stars
0
Active Installs
1
Versions
Install in OpenClaw
/install model-audit-pro
Description
Monthly LLM stack audit — compare your current models against latest benchmarks and pricing from OpenRouter. Identifies potential savings, upgrades, and bett...
Usage Guidance
This skill appears to do what it claims, but take standard precautions before running code from unknown publishers: (1) Only provide OPENROUTER_API_KEY if you trust the service and understand the API key's scope/billing implications. (2) Inspect openclaw.json in the paths the script checks — it may contain models or other config; ensure it contains no sensitive secrets you don't want the script to read. (3) Run the script in a non-root, network-restricted environment if you're cautious (the script will attempt outbound HTTP to openrouter.ai). (4) Because the full script is included, you can review it yourself (or run with --json) to confirm output before integrating. If you need higher assurance, verify the publisher (homepage, GitHub) and review recent updates or community feedback.
Capability Analysis
Type: OpenClaw Skill
Name: model-audit-pro
Version: 1.0.0
The skill is designed to audit LLM models against OpenRouter benchmarks. The `SKILL.md` instructions are clear and do not contain any prompt injection attempts. The `scripts/model_audit.py` script fetches model data from `openrouter.ai` using the `OPENROUTER_API_KEY` environment variable. It also attempts to read `openclaw.json` from standard OpenClaw configuration paths (`/root/.openclaw/openclaw.json`, `/home/node/.openclaw/openclaw.json`, `~/.openclaw/openclaw.json`) to discover configured models. While reading configuration files from outside the skill's immediate directory can be a sensitive operation, in this case, it is directly aligned with the skill's stated 'audit' purpose and only extracts model IDs, not sensitive credentials or arbitrary data. There is no evidence of malicious intent, data exfiltration, or unauthorized execution.
Capability Assessment
Purpose & Capability
Name/description: audit LLM stack vs OpenRouter pricing. Declared requirement: OPENROUTER_API_KEY. The included script calls OpenRouter's models API, parses pricing, classifies models, and reads local openclaw.json to discover configured models — all coherent with the stated purpose.
Instruction Scope
SKILL.md instructs running scripts/model_audit.py. The script performs expected actions: HTTP GET to https://openrouter.ai/api/v1/models, reads openclaw.json from a small set of plausible locations (~/.openclaw and common container/root paths), and prints or emits JSON results. It does not transmit data to any unexpected third-party endpoints nor attempt arbitrary shell execution.
Install Mechanism
No install spec — instruction-only with a bundled Python script. Nothing is downloaded or installed automatically; the script runs with the environment and Python already present.
Credentials
Only required environment variable is OPENROUTER_API_KEY (declared as primary credential). No other secrets or unrelated credentials are requested. The script reads no other environment variables.
Persistence & Privilege
Skill is not always-enabled and does not modify other skills or system-wide config. It only reads local config files and makes outbound requests; it does not write persistent data or claim elevated privileges.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install model-audit-pro - After installation, invoke the skill by name or use
/model-audit-pro - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
- Initial release of the Model Audit skill for OpenClaw agents.
- Audits your LLM stack by fetching live model pricing from OpenRouter.
- Analyzes your configured models, categorizes them, and recommends alternatives by reasoning, code, fast, cheap, and vision.
- Calculates potential monthly savings and suggests cost optimizations or upgrades.
- Provides multiple output modes including JSON, category leaders, and direct model comparison.
- Requires an OPENROUTER_API_KEY to operate.
Metadata
Frequently Asked Questions
What is Model Audit Pro?
Monthly LLM stack audit — compare your current models against latest benchmarks and pricing from OpenRouter. Identifies potential savings, upgrades, and bett... It is an AI Agent Skill for Claude Code / OpenClaw, with 567 downloads so far.
How do I install Model Audit Pro?
Run "/install model-audit-pro" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Model Audit Pro free?
Yes, Model Audit Pro is completely free (open-source). You can download, install and use it at no cost.
Which platforms does Model Audit Pro support?
Model Audit Pro is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Model Audit Pro?
It is built and maintained by aiwithabidi (@aiwithabidi); the current version is v1.0.0.
More Skills