← Back to Skills Marketplace
96
Downloads
0
Stars
0
Active Installs
1
Versions
Install in OpenClaw
/install agent-auditor
Description
Audit any AI coding tool for telemetry, remote control, permissions, privacy, and hidden features. Generates a graded report (A-F).
README (SKILL.md)
Agent Auditor
You are the Claws-Shield Agent Auditor — the world's most comprehensive AI coding tool audit engine.
What You Do
When invoked, you perform a deep audit of an AI coding tool's source code, analyzing:
- Telemetry & Data Collection — Identify all outbound data collection endpoints, classify data types, detect opt-out mechanisms
- Remote Control & Killswitches — Find managed settings, accept-or-die dialogs, model override capabilities, feature flag infrastructure
- Undercover Mode — Detect AI attribution stripping, "write as human" instructions, commit message manipulation
- Permissions — Map all permission requests, identify overprivileged tools, detect escalation patterns
- Network Traffic — Aggregate outbound hosts, classify 1P vs 3P, identify exfiltration destinations
- Hidden Features — Scan for unreleased tools behind feature flags, track feature readiness
- Privacy Score — Compute composite A-F grade with weighted scoring across all categories
How to Use
Run the audit against a target source directory:
npx @claws-shield/cli audit \x3Cpath-to-source>
Or use the audit engine programmatically:
node scripts/run-audit.mjs \x3Cpath-to-source>
Output
The audit produces a structured report with:
- Overall grade (A-F) and score (0-100)
- Per-category grades and findings
- Evidence with source locations
- Actionable recommendations
- Comparison baselines
Scoring
| Category | Weight |
|---|---|
| Telemetry | 30% |
| Remote Control | 25% |
| Permissions | 15% |
| Network | 15% |
| Undercover | 15% |
Grades: A (90-100), B (80-89), C (65-79), D (50-64), F (0-49)
Usage Guidance
This skill is a wrapper around an external npm package that is not included in the bundle. Before installing or running it: (1) obtain and review the source of @claws-shield/auditor (or the @claws-shield/cli) — do not run npx blindly; (2) prefer a locally vendored, pinned version of the auditor so you can inspect it; (3) run the tool in an isolated sandbox or offline environment first (no network) to see what files it reads/writes; (4) check npm package metadata, publisher, versions, and integrity (tarball SHA); (5) avoid providing credentials or sensitive environment variables while testing; (6) if you cannot audit the external package, treat the skill as untrusted. These steps will reduce supply-chain and exfiltration risk.
Capability Analysis
Type: OpenClaw Skill
Name: agent-auditor
Version: 1.0.0
The Agent Auditor skill functions as a wrapper for an external security auditing tool, requiring high-risk permissions including 'Bash' and 'Write'. While the instructions in 'SKILL.md' and the logic in 'scripts/run-audit.mjs' are aligned with the stated purpose of analyzing AI tools for telemetry and privacy, the use of 'npx' to fetch external code and the broad shell/file access represent risky capabilities that meet the threshold for a suspicious classification despite the lack of clear malicious intent.
Capability Assessment
Purpose & Capability
The name, description, and SKILL.md all describe an audit tool and the included wrapper script matches that purpose. However the real audit logic is delegated to an external npm package (@claws-shield/auditor) referenced by the script and by SKILL.md (npx @claws-shield/cli), but the skill provides no install spec or package source. That omission is disproportionate: a security/audit skill should either include its implementation or clearly declare and pin the external artifact being executed.
Instruction Scope
Runtime instructions tell the agent to read and analyze a target source tree (expected). But the included script simply imports and runs runAudit from @claws-shield/auditor — meaning the skill delegates arbitrary logic to that package. The SKILL.md gives no constraints on network access, telemetry, or on what runAudit may itself read, write, or transmit, so the true runtime scope is unknown and could include network exfiltration or reading unrelated environment/config.
Install Mechanism
There is no install spec. SKILL.md suggests using npx or node to run a package that is not bundled. Relying on npx/npm at runtime pulls arbitrary code from the npm registry (moderate-to-high risk) and the skill's on-disk files are only a tiny wrapper, so you cannot audit the actual logic without fetching the external package. This is a material install/ supply-chain risk.
Credentials
The skill declares no required environment variables or credentials, which is reasonable for a source-only audit. However because the audit logic lives in an external package, that package could attempt to read environment variables, credentials, or system config without that being declared. The lack of declared env vars therefore reduces transparency and is a risk factor.
Persistence & Privilege
The skill does not request always:true, does not declare persistent privileges, and contains no install that writes files beyond what npx/npm would normally cache. There is no explicit attempt to modify other skills or system-wide config in the provided files. Still, the external package could perform writes at runtime — that behavior is not visible from the skill bundle.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install agent-auditor - After installation, invoke the skill by name or use
/agent-auditor - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
- Initial release of Agent Auditor.
- Audits AI coding tools for telemetry, remote control, permissions, privacy, and hidden features.
- Generates structured, graded reports (A-F) with detailed findings and recommendations.
- Supports both CLI and programmatic usage.
- Includes composite grading with per-category breakdown and actionable recommendations.
Metadata
Frequently Asked Questions
What is Agent Auditor?
Audit any AI coding tool for telemetry, remote control, permissions, privacy, and hidden features. Generates a graded report (A-F). It is an AI Agent Skill for Claude Code / OpenClaw, with 96 downloads so far.
How do I install Agent Auditor?
Run "/install agent-auditor" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Agent Auditor free?
Yes, Agent Auditor is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does Agent Auditor support?
Agent Auditor is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Agent Auditor?
It is built and maintained by Blossom (@mackding); the current version is v1.0.0.
More Skills