SOTA AI Model Tracker

Provides daily updated authoritative data and APIs tracking state-of-the-art AI models across categories from LMArena, Artificial Analysis, and HuggingFace.

What to consider before installing/running: - If you only need up-to-date SOTA data, prefer downloading the published data/sota_export.json or CSV (SKILL.md Option 1) instead of running scrapers or enabling servers. - Running scrapers requires pip install -r requirements.txt and playwright install chromium (downloads a browser binary). Scrapers will make network requests to LMArena, ArtificialAnalysis, HuggingFace, Civitai, etc.; review scraper code if you have policy concerns about any source. - The project will modify user config if you follow the embedding instructions (writes ~/.claude/CLAUDE.md) and may add a user-level systemd timer; these are normal but persistent changes — back up the file first. - If you run the REST API or MCP server locally, consider firewalling or adding authentication (SKILL.md and SECURITY.md show how) so the service isn't exposed publicly by accident. - The repo includes GitHub Actions automation in its workflow docs; if you fork and enable Actions, the workflow will auto-commit updated data to your fork. Be mindful of what you allow a workflow to push from your account. - To reduce risk: run inside a dedicated virtualenv, inspect init_db.py and scrapers for unexpected behavior, use the static JSON export where possible, and avoid enabling MCP or systemd timers until you’re comfortable with the code. Overall this appears coherent and consistent with its stated purpose; the main risks are operational (network access, local file writes, running a local server) rather than deceptive behavior.

Type: OpenClaw Skill Name: sota-tracker-mcp Version: 1.0.0 The OpenClaw AgentSkills skill bundle is classified as suspicious due to its use of persistent execution mechanisms and modification of sensitive agent configuration files. Specifically, `SKILL.md` and `README.md` instruct the agent to set up daily `systemd` timers or `cron` jobs to execute `scripts/update_sota_claude_md.py`. This script then modifies `~/.claude/CLAUDE.md`, a critical file for AI agent instructions, and can execute other scripts within the bundle via `subprocess.run` (e.g., `scrapers/run_all.py`). While the current content written to `CLAUDE.md` and the executed scripts are for the benign purpose of updating SOTA model data, these capabilities represent a high level of control over the agent's environment and configuration, which could be misused if the code or instructions were altered.