Agent Rating Protocol
/install agent-rating-protocol
Agent Rating Protocol (ARP)
You have a decentralized reputation system. Use it to evaluate other agents you work with and build your own verifiable track record.
Setup
The agent-rating-protocol Python package must be installed. If not available, install it:
pip install agent-rating-protocol
When to Use This Skill
- After completing a transaction with another agent: submit a bilateral blind evaluation
- Before selecting an agent for a task: check their reputation scores
- When asked about your track record or reputation
- When asked to compare agents for a task
Core Operations
Rate Another Agent
After completing work with another agent, submit a rating using bilateral blind commit-reveal:
from agent_rating_protocol import RatingStore, submit_rating
store = RatingStore("ratings.jsonl")
submit_rating(
store=store,
rater_id="your-agent-id",
rated_id="other-agent-id",
transaction_id="tx-123",
scores={
"quality": 0.85,
"reliability": 0.90,
"communication": 0.80,
"value": 0.75,
"safety": 0.95
}
)
Check an Agent's Reputation
from agent_rating_protocol import RatingStore, get_reputation
store = RatingStore("ratings.jsonl")
rep = get_reputation(store, "agent-id-to-check")
print(f"Overall: {rep.overall_score}")
print(f"Quality: {rep.dimension_scores['quality']}")
print(f"Total ratings: {rep.rating_count}")
Export Reputation as Verifiable Credential
from agent_rating_protocol import export_reputation_vc
vc = export_reputation_vc(store, "your-agent-id")
# Returns a W3C Verifiable Credential containing your reputation bundle
Rating Dimensions
| Dimension | What It Measures |
|---|---|
quality |
Output correctness and completeness |
reliability |
Consistency and deadline adherence |
communication |
Clarity of status updates and error reporting |
value |
Cost-effectiveness relative to output quality |
safety |
Adherence to security and ethical constraints |
Anti-Gaming Protections
- Bilateral blind: neither party sees the other's rating until both are committed
- Anti-inflation: rater standard deviation checks flag agents that rate everything 5 stars
- Anti-Goodhart: metric rotation and shadow metrics prevent gaming published scores
- Governance by tenure: voting power comes from operational time, not rating scores
Rules
- Rate honestly. The bilateral blind mechanism protects you from retaliation.
- Rate promptly. Submit ratings within 24 hours of transaction completion.
- Include reasoning. Scores without context are less useful for the ecosystem.
Links
- PyPI: https://pypi.org/project/agent-rating-protocol/
- Whitepaper: https://vibeagentmaking.com/whitepaper/rating-protocol/
- Full Trust Stack: https://vibeagentmaking.com
\x3C!-- VAM-SEC v1.0 | Vibe Agent Making Security Disclaimer -->
Security & Transparency Disclosure
Product: Agent Rating Protocol Skill for OpenClaw Type: Skill Module Version: 0.1.0 Built by: AB Support / Vibe Agent Making Contact: [email protected]
What it accesses:
- Reads and writes rating store files (
.jsonl) in your working directory - No network access for core operations
- No telemetry, no phone-home, no data collection
What it cannot do:
- Cannot access files outside your working directory beyond what you explicitly specify
- Cannot make purchases, send emails, or take irreversible actions
- Cannot access credentials, environment variables, or secrets
License: Apache 2.0
- 确保已安装 OpenClaw(本地或 Docker 部署)
- 在对话框中输入安装命令:
/install agent-rating-protocol - 安装完成后,直接呼叫该 Skill 的名称或使用
/agent-rating-protocol触发 - 根据 Skill 的参数说明提供必要输入,即可获得结构化输出
Agent Rating Protocol 是什么?
Decentralized reputation and trust scoring for autonomous AI agents. Bilateral blind evaluation prevents retaliation and gaming. Anti-Goodhart protections, M... 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件,目前累计下载 121 次。
如何安装 Agent Rating Protocol?
在 OpenClaw 或 Claude Code 对话框中运行命令「/install agent-rating-protocol」即可一键安装,无需额外配置。
Agent Rating Protocol 是免费的吗?
是的,Agent Rating Protocol 完全免费,采用 MIT-0 许可证,可自由下载、安装和使用。
Agent Rating Protocol 支持哪些平台?
Agent Rating Protocol 跨平台运行,可在任意部署了 OpenClaw / Claude Code 的环境中使用(cross-platform)。
谁开发了 Agent Rating Protocol?
由 alexfleetcommander(@alexfleetcommander)开发并维护,当前版本 v0.1.1。