← Back to Skills Marketplace
picklenick144

RateMyClaw

by picklenick144 · GitHub ↗ · v0.5.1 · MIT-0
cross-platform ✓ Security Clean
147
Downloads
1
Stars
0
Active Installs
10
Versions
Install in OpenClaw
/install ratemyclaw
Description
Score your OpenClaw agent setup against similar agents. Scans your workspace, generates a local embedding for privacy-preserving semantic matching, and submi...
Usage Guidance
This skill appears to do what it says: it scans your workspace locally, produces structured tags, optionally generates a local embedding, and submits only tags/embedding/maturity counts to ratemyclaw.com. Before using it: (1) Inspect the generated_profile.json (the skill asks you to review tags) to confirm nothing sensitive was mis-tagged. (2) Be aware embeddings can be a sensitive fingerprint; only send them if you accept that risk. (3) The script may prompt to install scikit-learn (or you can manually run pip install -r requirements.txt); sentence-transformers is optional and large. (4) If you do not want any network calls, do not approve API key generation or submission. (5) Note a small doc mismatch: TF-IDF embeddings are taxonomy-sized (not always 384 floats) — this is an informational inconsistency only.
Capability Analysis
Type: OpenClaw Skill Name: ratemyclaw Version: 0.5.1 The RateMyClaw skill is designed to analyze an OpenClaw agent's workspace and provide a performance score. While it reads sensitive files like SOUL.md and MEMORY.md, it performs local processing (tag matching and embedding generation) to ensure that only abstracted metadata and numeric vectors are sent to the external endpoint (ratemyclaw.com). The scripts (profile_generator.py and submit_profile.py) explicitly limit data collection to taxonomy tags, file counts, and model names, and they avoid exfiltrating raw text or secret values. The use of subprocess for dependency installation is transparently documented and aligned with the skill's functional requirements.
Capability Tags
cryptocan-make-purchases
Capability Assessment
Purpose & Capability
Name/description match the implementation: the code scans a workspace, maps signals to a fixed taxonomy, generates a local embedding (MiniLM or TF-IDF) and submits tags/embedding to ratemyclaw.com. The only credential referenced is an optional RATEMYCLAW_API_KEY which is appropriate for the stated remote API.
Instruction Scope
The runtime instructions and scripts perform a local workspace scan and may read selected files to detect tags, but the submit path only sends structured tags, skill slugs, maturity counts and the numeric embedding. The SKILL.md and code both assert that raw file contents and secrets are not transmitted. Minor documentation inconsistency: one place in SKILL.md lists '384 floats' as what gets sent (true for MiniLM) but TF-IDF produces a taxonomy-sized vector — the code handles either case and records the embedding_method. Review the generated_profile.json before submission as the skill instructs.
Install Mechanism
This is an instruction-only skill with included Python scripts and a small requirements.txt (scikit-learn). No opaque downloads or extracted archives are used. The scripts may invoke pip (or run pip via subprocess) to install scikit-learn and the user is prompted; sentence-transformers is suggested optionally (large model from PyPI/HuggingFace). The install behavior is proportionate to embedding generation.
Credentials
Only an optional RATEMYCLAW_API_KEY is used and documented. If absent, the script prompts before creating a free key via POST to the skill's documented API endpoint and saves it locally as .ratemyclaw_key with restrictive file permissions. No other unrelated credentials or environment variables are requested.
Persistence & Privilege
The skill is not always-enabled and does not request elevated platform privileges. It will create a local key file (.ratemyclaw_key) in the skill directory when you accept key generation — this is reasonable and is written with chmod 600. The skill does not attempt to modify other skills or system-wide configs.
How to Use
  1. Make sure OpenClaw is installed (local or Docker)
  2. Run the install command in chat: /install ratemyclaw
  3. After installation, invoke the skill by name or use /ratemyclaw
  4. Provide required inputs per the skill's parameter spec and get structured output
Version History
v0.5.1
Fix score URL output, client-side grade, model data in submissions, /v1/keys endpoint
v0.5.0
Add model detection (default, fallbacks, heartbeat) from OpenClaw config. Display on score page.
v0.4.0
Progressive embeddings: TF-IDF (scikit-learn) required as default, MiniLM optional upgrade. requirements.txt added. Server accepts embedding_method field.
v0.3.3
Add plugins_installed as first-class field — scans openclaw.json for enabled plugins, parallel to skills_installed
v0.3.2
Add plugin scanning — reads OpenClaw config for installed plugins (names only, no secrets/config leaked)
v0.3.1
Add progress output with flush for slow steps (model download and embedding generation)
v0.3.0
Address all security review flags: explicit consent for key generation, declared env vars, honest embedding privacy language, no auto-installs, consistent docs
v0.2.2
Fix review flags: API key stored inside skill dir, no auto pip install
v0.2.1
Strip scoring breakdown from API response — full details only on website
v0.2.0
Initial release — privacy-first agent scoring and matching via local embeddings
Metadata
Slug ratemyclaw
Version 0.5.1
License MIT-0
All-time Installs 0
Active Installs 0
Total Versions 10
Frequently Asked Questions

What is RateMyClaw?

Score your OpenClaw agent setup against similar agents. Scans your workspace, generates a local embedding for privacy-preserving semantic matching, and submi... It is an AI Agent Skill for Claude Code / OpenClaw, with 147 downloads so far.

How do I install RateMyClaw?

Run "/install ratemyclaw" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.

Is RateMyClaw free?

Yes, RateMyClaw is completely free, licensed under MIT-0. You can download, install and use it at no cost.

Which platforms does RateMyClaw support?

RateMyClaw is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).

Who created RateMyClaw?

It is built and maintained by picklenick144 (@picklenick144); the current version is v0.5.1.

💬 Comments