← Back to Skills Marketplace
zack-dev-cm

SOTA Agent

by Zakhar Pashkin · GitHub ↗ · v1.4.2 · MIT-0
cross-platform ✓ Security Clean
285
Downloads
2
Stars
1
Active Installs
10
Versions
Install in OpenClaw
/install sota-agent
Description
SOTA Agent is a public ClawHub SOTA-campaign skill for CV and DS work. Use it when the user says "sota agent", "state of the art benchmark scouting", or want...
Usage Guidance
This skill appears coherent and appropriate for coordinating SOTA campaigns, but do these checks before installing or running it: 1) Inspect scripts/sota_public_safety.py (and the 4 omitted files) to confirm path/url sanitization and confirm there are no hidden network calls or credential usage. 2) Run the scripts in a dedicated campaign folder (not your home or /) so that file writes and any path resolutions stay isolated. 3) Do not pass secret-containing paths or API keys as arguments; the tool is designed to avoid requiring secrets. 4) If you plan to run any execution lanes (browser automation, VMs, Colab), prefer the paired execution skill the docs recommend and review its install/credential requirements separately. 5) If you need extra assurance, run the scripts in a sandbox or inspect them with a linter/static scanner to verify the omitted files contain no unexpected network or exec behavior.
Capability Analysis
Type: OpenClaw Skill Name: sota-agent Version: 1.4.2 The sota-agent skill bundle is a comprehensive framework for managing data science and computer vision research campaigns. It contains no evidence of malicious intent; rather, it includes significant security-conscious features, such as the 'sota_public_safety.py' utility and 'public-safety.md' documentation, which are specifically designed to redact secrets, API keys, and private filesystem paths from research artifacts. The bundle explicitly forbids the use of sensitive environment variables like OPENAI_API_KEY in favor of OAuth-backed sessions, and its scripts are limited to local file scaffolding and markdown rendering.
Capability Tags
requires-oauth-tokenrequires-sensitive-credentials
Capability Assessment
Purpose & Capability
The name and description claim a SOTA campaign planning and candidate-selection layer; the packaged Python helper scripts and long SKILL.md provide scaffolding and JSON artifact creators that directly match that purpose. Required binaries (python/python3) are appropriate. There are no unexpected credentials, cloud SDKs, or unrelated binaries requested.
Instruction Scope
The SKILL.md instructs the agent (or user) to use included Python scripts to initialize campaign artifacts, leaderboards, run-cards, scorecards, VM manifests, etc. Those instructions operate on local paths and produce JSON artifacts; they do not instruct the agent to read arbitrary system files, call external endpoints, or exfiltrate secrets. The docs explicitly instruct keeping all writes inside a campaign workspace and point to a sanitization module (sota_public_safety) for redaction.
Install Mechanism
No install spec is provided (instruction-only), which is low-risk, but the repository includes multiple runnable Python scripts. This is coherent for a tooling skill, but note the slight mismatch: the registry metadata calls it instruction-only while shipping executable code files. There is no network download or third-party package installation declared.
Credentials
The skill declares no required environment variables or credentials and its references and scripts explicitly discourage paid API-key dependencies. Scripts check and sanitize paths and use local filesystem operations only. No secret-shaped env vars are requested.
Persistence & Privilege
always is false; the skill does not request permanent presence nor system-level changes. The scripts write artifacts to local paths provided by the user and do not modify other skills or global agent settings.
How to Use
  1. Make sure OpenClaw is installed (local or Docker)
  2. Run the install command in chat: /install sota-agent
  3. After installation, invoke the skill by name or use /sota-agent
  4. Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.4.2
Harden public release safety wording and refresh skill metadata.
v1.4.1
Polish public wording in published skill docs.
v1.4.0
Add execution dashboard, source audit, and leakage audit references to claim review.
v1.3.0
Add campaign harness records, richer summaries, and cleaner public prompts.
v1.2.3
Make the public redaction helper explicit and tighten workspace path guidance
v1.2.2
Reduce public artifact metadata and remove audit-command snippets from the bundle
v1.2.1
Remove hash and env capture from the public SOTA execution helpers
v1.2.0
Shorten the public summary and keep refs, paths, env, and command redaction always on
v1.1.0
Add OpenClaw browser, GUI notebook, Colab, and GPU VM execution helpers to the SOTA workflow
v1.0.0
Add a public OpenClaw skill for benchmark governance, paper triage, ablations, and SOTA claim review
Metadata
Slug sota-agent
Version 1.4.2
License MIT-0
All-time Installs 1
Active Installs 1
Total Versions 10
Frequently Asked Questions

What is SOTA Agent?

SOTA Agent is a public ClawHub SOTA-campaign skill for CV and DS work. Use it when the user says "sota agent", "state of the art benchmark scouting", or want... It is an AI Agent Skill for Claude Code / OpenClaw, with 285 downloads so far.

How do I install SOTA Agent?

Run "/install sota-agent" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.

Is SOTA Agent free?

Yes, SOTA Agent is completely free, licensed under MIT-0. You can download, install and use it at no cost.

Which platforms does SOTA Agent support?

SOTA Agent is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).

Who created SOTA Agent?

It is built and maintained by Zakhar Pashkin (@zack-dev-cm); the current version is v1.4.2.

💬 Comments