← Back to Skills Marketplace
Agent Reliability
by
yuyonghao-123
· GitHub ↗
· v0.1.0
· MIT-0
133
Downloads
0
Stars
0
Active Installs
1
Versions
Install in OpenClaw
/install yuyonghao-agent-reliability
Description
Provides error monitoring, automatic fallback, confidence evaluation, and multi-agent voting to maintain accuracy in multi-step workflows.
Usage Guidance
This package appears designed to provide reliability tooling, but it contains multiple coherence issues that make it unreliable rather than malicious. Before installing or enabling it in any agent:
- Don't deploy to production yet. Run the tests locally (npm test) in an isolated environment to observe failures.
- Manually review the exported API surface: the tests call consensus.getSession and consensus.getStats and the ReportGenerator expects monitor.getStats(), but the codebase does not define these public methods consistently (ReliabilityMonitor provides getReliabilityScore(), VotingConsensus has no getSession/getStats accessor). These mismatches will cause runtime errors.
- Inspect ReportGenerator.generateMarkdown: it expects stats.successRate, stats.total, stats.successful, stats.failed, and stats.byStep, but the monitor returns a different object shape — that will produce incorrect reports.
- If you plan to use this library, either obtain a fixed release from a trusted source or patch the code to reconcile the API mismatches (add missing accessors or adjust callers).
- Because there are no network calls or secret requests in the code, immediate credential exfiltration risk is low; however, the poor code quality could hide other bugs — review all modules before automated or autonomous agent use.
If you want, I can list the exact mismatches and propose minimal patches to make the public API consistent with the tests/examples (e.g., add getStats/getSession wrappers or change ReportGenerator to consume getReliabilityScore()).
Capability Assessment
Purpose & Capability
The name, description, SKILL.md examples, and most source files (ReliabilityMonitor, FallbackManager, ConfidenceCalculator, VotingConsensus, ReportGenerator) consistently implement monitoring, fallback, confidence calculation, and voting/consensus features — these align with the skill's stated purpose.
Instruction Scope
SKILL.md usage examples are limited to requiring the module, creating objects, and calling library methods (no instructions to read system files, exfiltrate data, or call external endpoints). However, the included test suite and some modules expect or call APIs that are either missing or mismatched (see below), which means runtime behavior could be broken or behave unexpectedly if consumers follow the examples.
Install Mechanism
No install spec beyond 'npm install' in SKILL.md; package.json has no external dependencies and no install-time downloads. This is low risk from an installer perspective (no arbitrary remote code fetched during install).
Credentials
No required environment variables, no required binaries, and no requested config paths — the requested permissions are proportional to a pure JavaScript library.
Persistence & Privilege
Skill flags are default (not always:true), and there is no code that attempts to persistently modify agent/platform configuration or access other skills' credentials. No privileged persistence behavior detected.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install yuyonghao-agent-reliability - After installation, invoke the skill by name or use
/yuyonghao-agent-reliability - Provide required inputs per the skill's parameter spec and get structured output
Version History
v0.1.0
Initial release of Agent Reliability framework.
- Provides real-time error rate monitoring with historical trend analysis and anomaly alerts.
- Introduces an automatic fallback mechanism with configurable strategies and graceful degradation.
- Includes step-wise and cumulative confidence evaluation with visualization and threshold alerts.
- Adds multi-agent voting consensus feature supporting various strategies and conflict resolution.
- Usage examples for ReliabilityMonitor, FallbackManager, and VotingConsensus included.
Metadata
Frequently Asked Questions
What is Agent Reliability?
Provides error monitoring, automatic fallback, confidence evaluation, and multi-agent voting to maintain accuracy in multi-step workflows. It is an AI Agent Skill for Claude Code / OpenClaw, with 133 downloads so far.
How do I install Agent Reliability?
Run "/install yuyonghao-agent-reliability" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Agent Reliability free?
Yes, Agent Reliability is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does Agent Reliability support?
Agent Reliability is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Agent Reliability?
It is built and maintained by yuyonghao-123 (@yuyonghao-123); the current version is v0.1.0.
More Skills