← Back to Skills Marketplace
Pa Eval
by
Netanel Abergel
· GitHub ↗
· v1.0.1
· MIT-0
136
Downloads
0
Stars
1
Active Installs
2
Versions
Install in OpenClaw
/install pa-eval
Description
Evaluate PA performance through structured scoring, owner feedback analysis, and behavioral benchmarking. Use when: conducting a weekly/monthly PA performanc...
Usage Guidance
This skill appears coherent and minimal: it only creates local eval files and scores PA performance. Before installing, confirm two operational details: (1) what channels/events the agent will monitor to detect owner feedback (so you avoid unintended message monitoring), and (2) file location/retention and permissions for $HOME/.openclaw/workspace/.learnings/eval. If you want stricter control, disable automatic runs and require manual invocation for weekly/monthly reports.
Capability Analysis
Type: OpenClaw Skill
Name: pa-eval
Version: 1.0.1
The skill bundle is a performance evaluation tool for an AI agent, designed to track metrics like accuracy and speed. It includes a simple bash script in SKILL.md that creates a local directory (~/.openclaw/workspace/.learnings/eval) and writes markdown templates for logging, which is consistent with its stated purpose and lacks any indicators of malicious intent or data exfiltration.
Capability Assessment
Purpose & Capability
The name/description (PA performance scoring, feedback, benchmarks) match the instructions: templates, weekly/monthly aggregation, and simple benchmark calculations. No unrelated binaries, cloud credentials, or surprising permissions are requested.
Instruction Scope
Instructions tell the agent to create weekly eval files under $HOME/.openclaw/workspace/.learnings/eval, score dimensions, run monthly benchmarks, and 'log feedback signals automatically when detected.' The file writes and scoring are appropriate. The only ambiguity: 'log automatically when detected' and reaction/text signals assume the agent can monitor owner messages/reactions — the SKILL.md doesn't limit channels or explain how signals are detected. Confirm monitoring scope and privacy before enabling automatic logging.
Install Mechanism
Instruction-only skill with no install spec, no downloads, and no code files to execute beyond the provided small shell snippet; lowest-risk installation footprint.
Credentials
No environment variables, credentials, or config paths are requested. The requested filesystem write is a single per-user workspace path under $HOME, which is proportionate to the stated purpose.
Persistence & Privilege
Metadata sets always:false (not forced into all agents). The doc repeatedly says 'Run automatically' (every 7 days, 'log immediately'), which implies autonomous scheduling or event monitoring — this is reasonable for the skill's purpose but requires you to accept that the agent will autonomously create logs and monitor owner interactions if enabled. Consider limiting triggers or requiring explicit owner confirmation before automatic runs.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install pa-eval - After installation, invoke the skill by name or use
/pa-eval - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.1
reactions rule, close-the-loop, reply-to rules; skill-master analytics hook; skill-analytics added
v1.0.0
- Initial release of the pa-eval skill for structured PA performance evaluation.
- Provides weekly, correction-based, monthly, and on-demand performance reviews using a standardized scoring system (Execution, Accuracy, Speed, Proactivity, Communication, Memory, Tool Use, Judgment).
- Includes markdown templates for weekly self-evaluation and monthly reports, with grading and actionable feedback sections.
- Automates logging and analysis of owner feedback signals (positive/negative reactions, corrections, initiative/memory gaps).
- Benchmarks key performance metrics (task completion, accuracy, memory retention) and provides cost-saving usage tips.
Metadata
Frequently Asked Questions
What is Pa Eval?
Evaluate PA performance through structured scoring, owner feedback analysis, and behavioral benchmarking. Use when: conducting a weekly/monthly PA performanc... It is an AI Agent Skill for Claude Code / OpenClaw, with 136 downloads so far.
How do I install Pa Eval?
Run "/install pa-eval" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Pa Eval free?
Yes, Pa Eval is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does Pa Eval support?
Pa Eval is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Pa Eval?
It is built and maintained by Netanel Abergel (@netanel-abergel); the current version is v1.0.1.
More Skills