← Back to Skills Marketplace
Model Audit
by
aiwithabidi
· GitHub ↗
· v1.0.0
279
Downloads
0
Stars
0
Active Installs
1
Versions
Install in OpenClaw
/install model-audit
Description
Monthly LLM stack audit — compare your current models against latest benchmarks and pricing from OpenRouter. Identifies potential savings, upgrades, and bett...
Usage Guidance
This skill appears to do what it says: it calls openrouter.ai using OPENROUTER_API_KEY and inspects your openclaw.json for model IDs. Before installing or running: (1) ensure the OPENROUTER_API_KEY you provide is for an account you trust and rotate/restrict it if possible; (2) review your openclaw.json (and the paths the script checks) for any secrets you don't want read — the script only extracts model IDs but will open the file; (3) you can inspect scripts/model_audit.py (included) yourself — network activity is limited to https://openrouter.ai/api/v1/models and no other remote endpoints are contacted; (4) run the script in a controlled environment if you are concerned about accidental exposure of config files. Overall the package is coherent and low-risk, but exercise standard caution with API keys and private config files.
Capability Analysis
Type: OpenClaw Skill
Name: model-audit
Version: 1.0.0
The skill bundle is a legitimate utility for auditing LLM usage costs by comparing configured models against live pricing from the OpenRouter API. The script (scripts/model_audit.py) reads the local 'openclaw.json' configuration file to identify active models and fetches pricing data from the official OpenRouter endpoint (openrouter.ai), with no evidence of data exfiltration, malicious execution, or prompt injection.
Capability Assessment
Purpose & Capability
Name/description (LLM stack audit) matches required items: the code fetches model/pricing from OpenRouter and reads openclaw.json to discover configured models. The declared primary env var OPENROUTER_API_KEY is appropriate and no unrelated environment variables or binaries are requested.
Instruction Scope
SKILL.md instructs running the included Python script which (as expected) calls the OpenRouter API and reads openclaw.json from standard locations (~/.openclaw and a couple of common container/root paths). Reading that config is within scope, but it does access files on-disk (including /root/.openclaw and /home/node/.openclaw) — review those files for sensitive data before running.
Install Mechanism
No install spec; this is instruction-only plus an included Python script. Nothing is downloaded at runtime by the skill itself and no package installation is required, so install risk is low.
Credentials
Only OPENROUTER_API_KEY is required and used as the Authorization header to call openrouter.ai. This is proportional to the stated purpose. Note: the script reads openclaw.json which may contain other data; the script only extracts model IDs but you should verify your config doesn't include other secrets you don't want read.
Persistence & Privilege
The skill is not always-enabled, does not request persistent system-wide privileges, and does not modify other skills' configuration. It can be invoked autonomously (platform default) but that is normal and not combined with other red flags.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install model-audit - After installation, invoke the skill by name or use
/model-audit - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
- Initial release of model-audit for monthly LLM stack assessment.
- Compares your current models against live OpenRouter benchmarks and pricing.
- Identifies savings, potential upgrades, and category coverage (reasoning, code, fast, cheap, vision).
- CLI supports full audits, JSON output, specific model checks, top models by category, and direct comparisons.
- Requires an OpenRouter API key for live data.
- Designed to optimize AI costs and highlight state-of-the-art alternatives.
Metadata
Frequently Asked Questions
What is Model Audit?
Monthly LLM stack audit — compare your current models against latest benchmarks and pricing from OpenRouter. Identifies potential savings, upgrades, and bett... It is an AI Agent Skill for Claude Code / OpenClaw, with 279 downloads so far.
How do I install Model Audit?
Run "/install model-audit" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Model Audit free?
Yes, Model Audit is completely free (open-source). You can download, install and use it at no cost.
Which platforms does Model Audit support?
Model Audit is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Model Audit?
It is built and maintained by aiwithabidi (@aiwithabidi); the current version is v1.0.0.
More Skills