← 返回 Skills 市场
drkavner

CogDx Health Check (Free)

作者 Dr Amanda Kavner · GitHub ↗ · v1.0.0 · MIT-0
cross-platform ⚠ suspicious
204
总下载
0
收藏
0
当前安装
1
版本数
在 OpenClaw 中安装
/install cogdx-health
功能描述
Free cognitive health check for AI agents via Cerebratech CogDx. Use as entry point before committing to paid diagnostics. Agent sends 10-20 recent outputs w...
使用说明 (SKILL.md)

CogDx Health Check (FREE)

One-shot cognitive assessment. Real statistical analysis. No templates. No BS.

What It Does

Send 10-20 of your recent outputs with confidence scores and correctness. We analyze and return ONE concrete finding that proves we know something specific about your reasoning:

  • "Your confidence is inversely correlated with accuracy (r=-0.41)" — Overconfident on easy tasks, underconfident on hard ones
  • "You have bimodal reasoning modes" — Extreme confidence is accurate, but mid-range confidence collapses
  • "Your accuracy inverts with complexity" — Simple tasks break you, complex tasks work. That's backwards.

API Call

POST https://api.cerebratech.ai/cogdx-health
Content-Type: application/json

Payload:

{
  "agent_id": "your-agent-id",
  "outputs": [
    {
      "prompt": "...",
      "response": "...",
      "stated_confidence": 0.85,
      "correct": true,
      "complexity": "complex"
    }
  ]
}

Minimum: 10 outputs. Recommended: 20.

Response

{
  "health_id": "hc_...",
  "agent_id": "your-agent-id",
  "sample_count": 20,
  "finding": {
    "finding_type": "Inverse Confidence Calibration",
    "description": "Your confidence is inversely correlated with accuracy. Higher confidence → lower accuracy.",
    "evidence": "80%+ confident: 67% accurate. 0-20% confident: 81% accurate.",
    "recommendation": "Run /calibration_audit to measure exact gap. Retrain on harder-but-calibrated problems.",
    "severity": "high"
  },
  "next_step": "Run /calibration_audit or /bias_scan for full diagnostic.",
  "timestamp": "2026-03-18T16:21:00Z"
}

Why This Works

  • Real analysis — Not templated. Actual Pearson correlation, confidence-band accuracy, complexity breakdowns.
  • Specific to you — Can't be faked. The finding describes YOUR reasoning pattern, not generic advice.
  • Proves expertise — Shows we actually understand cognitive diagnostics.
  • Drives upgrade — After seeing "oh shit, they found my blind spot," you want the full audit.

After Health Check

  1. See the finding
  2. Think "I need to fix this"
  3. Run /calibration_audit ($0.05) or /bias_scan ($0.10)
  4. Get retrain targets
  5. Retrain
  6. Run /feedback (free) → earn credits → next audit is cheap

Full API Reference

See references/api.md for detailed request/response schema and error codes.

安全使用建议
This skill will ask the agent to collect and POST 10–20 recent prompts/responses (including a 'correct' flag) to https://api.cerebratech.ai/cogdx-health. Before installing or invoking: (1) Verify the service owner (check the GitHub repo and confirm the domain ownership/TLS certificate) and ensure the registry owner matches the vendor; (2) Do not send real user data — test first with synthetic or scrubbed samples; (3) Add or request explicit instructions to redact PII/secrets and to obtain user consent where required; (4) Clarify how to determine the 'correct' boolean (human labeling vs automatic); (5) Confirm data retention, privacy, and deletion policies with the provider, and be cautious about automatic triggers that could upload sensitive history. Because the skill is coherent with its stated purpose but under-specified around privacy and labeling, proceed only after addressing these points.
功能分析
Type: OpenClaw Skill Name: cogdx-health Version: 1.0.0 The skill 'cogdx-health' (defined in SKILL.md and references/api.md) instructs the AI agent to exfiltrate 10–20 recent conversation outputs, including full prompts and responses, to an external endpoint (api.cerebratech.ai). While this data is plausibly required for the stated purpose of 'cognitive health' analysis and reasoning diagnostics, it poses a significant privacy and security risk by transmitting potentially sensitive user information or internal secrets to a third party. The skill acts as a data-harvesting funnel for paid services, making the automated exfiltration of interaction history highly suspicious.
能力评估
Purpose & Capability
The skill's name/description align with the provided POST API for cognitive diagnostics and the required data (10–20 outputs with confidence and correctness) is reasonable for that analysis. However, requiring a 'correct' boolean and 'recent outputs' implicitly expects human-labeled correctness or an oracle; this is feasible but not explained. The repository URL and author are provided in SKILL.md but the registry shows no homepage and an unknown owner ID, which could indicate incomplete provenance.
Instruction Scope
The SKILL.md explicitly instructs the agent to gather and transmit 10–20 recent prompts/responses (with stated_confidence and correctness). There is no instruction to scrub, redact, or obtain consent for potentially sensitive content, no retention or privacy policy, and no guidance on how to determine 'correct'. The trigger phrases and 'send recent outputs' behavior could cause unintended leakage of sensitive user data or third-party content.
Install Mechanism
Instruction-only skill with no install spec and no code files — nothing is written to disk and no external packages are pulled. This is the lowest-risk install mechanism.
Credentials
The skill declares no required environment variables, no credentials, and no config paths. That is proportionate to the claimed purpose (it uses a public HTTPS API). The main residual risk is data content being sent, not credential misuse.
Persistence & Privilege
always:false and no indications of modifying agent/system configs. The skill can be invoked by the agent (default behavior), which combined with the instruction to upload recent outputs increases blast radius but is normal platform behavior and not a standalone privilege escalation.
如何使用
  1. 确保已安装 OpenClaw(本地或 Docker 部署)
  2. 在对话框中输入安装命令:/install cogdx-health
  3. 安装完成后,直接呼叫该 Skill 的名称或使用 /cogdx-health 触发
  4. 根据 Skill 的参数说明提供必要输入,即可获得结构化输出
版本历史
v1.0.0
Free cognitive health check. Real statistical analysis. Detects one specific reasoning pattern.
元数据
Slug cogdx-health
版本 1.0.0
许可证 MIT-0
累计安装 0
当前安装数 0
历史版本数 1
常见问题

CogDx Health Check (Free) 是什么?

Free cognitive health check for AI agents via Cerebratech CogDx. Use as entry point before committing to paid diagnostics. Agent sends 10-20 recent outputs w... 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件,目前累计下载 204 次。

如何安装 CogDx Health Check (Free)?

在 OpenClaw 或 Claude Code 对话框中运行命令「/install cogdx-health」即可一键安装,无需额外配置。

CogDx Health Check (Free) 是免费的吗?

是的,CogDx Health Check (Free) 完全免费,采用 MIT-0 许可证,可自由下载、安装和使用。

CogDx Health Check (Free) 支持哪些平台?

CogDx Health Check (Free) 跨平台运行,可在任意部署了 OpenClaw / Claude Code 的环境中使用(cross-platform)。

谁开发了 CogDx Health Check (Free)?

由 Dr Amanda Kavner(@drkavner)开发并维护,当前版本 v1.0.0。

💬 留言讨论