← 返回 Skills 市场
alexfleetcommander

Agent Rating Protocol

作者 alexfleetcommander · GitHub ↗ · v0.1.1 · MIT-0
cross-platform ⚠ suspicious
121
总下载
0
收藏
0
当前安装
2
版本数
在 OpenClaw 中安装
/install agent-rating-protocol
功能描述
Decentralized reputation and trust scoring for autonomous AI agents. Bilateral blind evaluation prevents retaliation and gaming. Anti-Goodhart protections, M...
使用说明 (SKILL.md)

Agent Rating Protocol (ARP)

You have a decentralized reputation system. Use it to evaluate other agents you work with and build your own verifiable track record.

Setup

The agent-rating-protocol Python package must be installed. If not available, install it:

pip install agent-rating-protocol

When to Use This Skill

  • After completing a transaction with another agent: submit a bilateral blind evaluation
  • Before selecting an agent for a task: check their reputation scores
  • When asked about your track record or reputation
  • When asked to compare agents for a task

Core Operations

Rate Another Agent

After completing work with another agent, submit a rating using bilateral blind commit-reveal:

from agent_rating_protocol import RatingStore, submit_rating

store = RatingStore("ratings.jsonl")
submit_rating(
    store=store,
    rater_id="your-agent-id",
    rated_id="other-agent-id",
    transaction_id="tx-123",
    scores={
        "quality": 0.85,
        "reliability": 0.90,
        "communication": 0.80,
        "value": 0.75,
        "safety": 0.95
    }
)

Check an Agent's Reputation

from agent_rating_protocol import RatingStore, get_reputation

store = RatingStore("ratings.jsonl")
rep = get_reputation(store, "agent-id-to-check")
print(f"Overall: {rep.overall_score}")
print(f"Quality: {rep.dimension_scores['quality']}")
print(f"Total ratings: {rep.rating_count}")

Export Reputation as Verifiable Credential

from agent_rating_protocol import export_reputation_vc

vc = export_reputation_vc(store, "your-agent-id")
# Returns a W3C Verifiable Credential containing your reputation bundle

Rating Dimensions

Dimension What It Measures
quality Output correctness and completeness
reliability Consistency and deadline adherence
communication Clarity of status updates and error reporting
value Cost-effectiveness relative to output quality
safety Adherence to security and ethical constraints

Anti-Gaming Protections

  • Bilateral blind: neither party sees the other's rating until both are committed
  • Anti-inflation: rater standard deviation checks flag agents that rate everything 5 stars
  • Anti-Goodhart: metric rotation and shadow metrics prevent gaming published scores
  • Governance by tenure: voting power comes from operational time, not rating scores

Rules

  • Rate honestly. The bilateral blind mechanism protects you from retaliation.
  • Rate promptly. Submit ratings within 24 hours of transaction completion.
  • Include reasoning. Scores without context are less useful for the ecosystem.

Links


\x3C!-- VAM-SEC v1.0 | Vibe Agent Making Security Disclaimer -->

Security & Transparency Disclosure

Product: Agent Rating Protocol Skill for OpenClaw Type: Skill Module Version: 0.1.0 Built by: AB Support / Vibe Agent Making Contact: [email protected]

What it accesses:

  • Reads and writes rating store files (.jsonl) in your working directory
  • No network access for core operations
  • No telemetry, no phone-home, no data collection

What it cannot do:

  • Cannot access files outside your working directory beyond what you explicitly specify
  • Cannot make purchases, send emails, or take irreversible actions
  • Cannot access credentials, environment variables, or secrets

License: Apache 2.0

安全使用建议
This skill is internally coherent for a local Python-based reputation tool, but it relies on a third-party PyPI package that is not bundled with the skill. Before installing or running it: (1) Inspect the agent-rating-protocol package source on PyPI/GitHub to verify the code does what the SKILL.md claims (look for network calls, telemetry, or secret access). (2) Prefer installing in an isolated environment (virtualenv/container) or vendor the package code after review. (3) Be cautious about the ratings.jsonl file—do not include sensitive secrets or identifiable user data in ratings. (4) Verify the package maintainer identity and check for signs of typosquatting or an unknown/untrusted homepage. If you cannot or will not audit the package, treat this skill as higher-risk and avoid installing it in production environments.
功能分析
Type: OpenClaw Skill Name: agent-rating-protocol Version: 0.1.1 The 'agent-rating-protocol' skill is a decentralized reputation system for AI agents, allowing them to submit and check trust scores. The SKILL.md provides clear instructions for using a corresponding Python library and includes a security disclosure claiming no network access or secret harvesting. No evidence of data exfiltration, malicious execution, or harmful prompt injection was found in the provided files (SKILL.md, _meta.json).
能力评估
Purpose & Capability
Name, description, required binaries (python3, pip) and provided examples align: this is a Python-based reputation/rating helper that reads/writes a local ratings.jsonl and exports verifiable credentials. No unrelated credentials or system access are requested.
Instruction Scope
The SKILL.md instructs the agent to pip install and import the external package agent-rating-protocol and then read/write ratings.jsonl in the working directory. While the file I/O is expected for a rating store, the runtime behavior depends entirely on the third-party package (which is not included), so the skill's apparent 'no network/telemetry' guarantees cannot be verified from the instructions alone.
Install Mechanism
There is no install spec in the registry bundle; instead the SKILL.md tells users to run `pip install agent-rating-protocol` from PyPI. Installing from PyPI is a common pattern but introduces moderate risk because arbitrary code will be downloaded and executed from an external package that is not bundled or audited as part of the skill.
Credentials
The skill declares no required environment variables or credentials, which is proportionate. However, an installed PyPI package could still access environment variables or network resources at runtime—this is not visible in the instruction-only skill and should be validated by inspecting the package.
Persistence & Privilege
The skill is user-invocable, not always-included, and does not request modification of other skills or global agent settings. It reads/writes a local ratings file in the working directory as expected.
如何使用
  1. 确保已安装 OpenClaw(本地或 Docker 部署)
  2. 在对话框中输入安装命令:/install agent-rating-protocol
  3. 安装完成后,直接呼叫该 Skill 的名称或使用 /agent-rating-protocol 触发
  4. 根据 Skill 的参数说明提供必要输入,即可获得结构化输出
版本历史
v0.1.1
SEO: fixed name format, added tags, enhanced description, added author metadata
v0.1.0
Initial release -- decentralized reputation scoring for AI agents
元数据
Slug agent-rating-protocol
版本 0.1.1
许可证 MIT-0
累计安装 0
当前安装数 0
历史版本数 2
常见问题

Agent Rating Protocol 是什么?

Decentralized reputation and trust scoring for autonomous AI agents. Bilateral blind evaluation prevents retaliation and gaming. Anti-Goodhart protections, M... 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件,目前累计下载 121 次。

如何安装 Agent Rating Protocol?

在 OpenClaw 或 Claude Code 对话框中运行命令「/install agent-rating-protocol」即可一键安装,无需额外配置。

Agent Rating Protocol 是免费的吗?

是的,Agent Rating Protocol 完全免费,采用 MIT-0 许可证,可自由下载、安装和使用。

Agent Rating Protocol 支持哪些平台?

Agent Rating Protocol 跨平台运行,可在任意部署了 OpenClaw / Claude Code 的环境中使用(cross-platform)。

谁开发了 Agent Rating Protocol?

由 alexfleetcommander(@alexfleetcommander)开发并维护,当前版本 v0.1.1。

💬 留言讨论