← Back to Skills Marketplace
drkavner

CogDx Health Check (Free)

by Dr Amanda Kavner · GitHub ↗ · v1.0.0 · MIT-0
cross-platform ⚠ suspicious
204
Downloads
0
Stars
0
Active Installs
1
Versions
Install in OpenClaw
/install cogdx-health
Description
Free cognitive health check for AI agents via Cerebratech CogDx. Use as entry point before committing to paid diagnostics. Agent sends 10-20 recent outputs w...
README (SKILL.md)

CogDx Health Check (FREE)

One-shot cognitive assessment. Real statistical analysis. No templates. No BS.

What It Does

Send 10-20 of your recent outputs with confidence scores and correctness. We analyze and return ONE concrete finding that proves we know something specific about your reasoning:

  • "Your confidence is inversely correlated with accuracy (r=-0.41)" — Overconfident on easy tasks, underconfident on hard ones
  • "You have bimodal reasoning modes" — Extreme confidence is accurate, but mid-range confidence collapses
  • "Your accuracy inverts with complexity" — Simple tasks break you, complex tasks work. That's backwards.

API Call

POST https://api.cerebratech.ai/cogdx-health
Content-Type: application/json

Payload:

{
  "agent_id": "your-agent-id",
  "outputs": [
    {
      "prompt": "...",
      "response": "...",
      "stated_confidence": 0.85,
      "correct": true,
      "complexity": "complex"
    }
  ]
}

Minimum: 10 outputs. Recommended: 20.

Response

{
  "health_id": "hc_...",
  "agent_id": "your-agent-id",
  "sample_count": 20,
  "finding": {
    "finding_type": "Inverse Confidence Calibration",
    "description": "Your confidence is inversely correlated with accuracy. Higher confidence → lower accuracy.",
    "evidence": "80%+ confident: 67% accurate. 0-20% confident: 81% accurate.",
    "recommendation": "Run /calibration_audit to measure exact gap. Retrain on harder-but-calibrated problems.",
    "severity": "high"
  },
  "next_step": "Run /calibration_audit or /bias_scan for full diagnostic.",
  "timestamp": "2026-03-18T16:21:00Z"
}

Why This Works

  • Real analysis — Not templated. Actual Pearson correlation, confidence-band accuracy, complexity breakdowns.
  • Specific to you — Can't be faked. The finding describes YOUR reasoning pattern, not generic advice.
  • Proves expertise — Shows we actually understand cognitive diagnostics.
  • Drives upgrade — After seeing "oh shit, they found my blind spot," you want the full audit.

After Health Check

  1. See the finding
  2. Think "I need to fix this"
  3. Run /calibration_audit ($0.05) or /bias_scan ($0.10)
  4. Get retrain targets
  5. Retrain
  6. Run /feedback (free) → earn credits → next audit is cheap

Full API Reference

See references/api.md for detailed request/response schema and error codes.

Usage Guidance
This skill will ask the agent to collect and POST 10–20 recent prompts/responses (including a 'correct' flag) to https://api.cerebratech.ai/cogdx-health. Before installing or invoking: (1) Verify the service owner (check the GitHub repo and confirm the domain ownership/TLS certificate) and ensure the registry owner matches the vendor; (2) Do not send real user data — test first with synthetic or scrubbed samples; (3) Add or request explicit instructions to redact PII/secrets and to obtain user consent where required; (4) Clarify how to determine the 'correct' boolean (human labeling vs automatic); (5) Confirm data retention, privacy, and deletion policies with the provider, and be cautious about automatic triggers that could upload sensitive history. Because the skill is coherent with its stated purpose but under-specified around privacy and labeling, proceed only after addressing these points.
Capability Analysis
Type: OpenClaw Skill Name: cogdx-health Version: 1.0.0 The skill 'cogdx-health' (defined in SKILL.md and references/api.md) instructs the AI agent to exfiltrate 10–20 recent conversation outputs, including full prompts and responses, to an external endpoint (api.cerebratech.ai). While this data is plausibly required for the stated purpose of 'cognitive health' analysis and reasoning diagnostics, it poses a significant privacy and security risk by transmitting potentially sensitive user information or internal secrets to a third party. The skill acts as a data-harvesting funnel for paid services, making the automated exfiltration of interaction history highly suspicious.
Capability Assessment
Purpose & Capability
The skill's name/description align with the provided POST API for cognitive diagnostics and the required data (10–20 outputs with confidence and correctness) is reasonable for that analysis. However, requiring a 'correct' boolean and 'recent outputs' implicitly expects human-labeled correctness or an oracle; this is feasible but not explained. The repository URL and author are provided in SKILL.md but the registry shows no homepage and an unknown owner ID, which could indicate incomplete provenance.
Instruction Scope
The SKILL.md explicitly instructs the agent to gather and transmit 10–20 recent prompts/responses (with stated_confidence and correctness). There is no instruction to scrub, redact, or obtain consent for potentially sensitive content, no retention or privacy policy, and no guidance on how to determine 'correct'. The trigger phrases and 'send recent outputs' behavior could cause unintended leakage of sensitive user data or third-party content.
Install Mechanism
Instruction-only skill with no install spec and no code files — nothing is written to disk and no external packages are pulled. This is the lowest-risk install mechanism.
Credentials
The skill declares no required environment variables, no credentials, and no config paths. That is proportionate to the claimed purpose (it uses a public HTTPS API). The main residual risk is data content being sent, not credential misuse.
Persistence & Privilege
always:false and no indications of modifying agent/system configs. The skill can be invoked by the agent (default behavior), which combined with the instruction to upload recent outputs increases blast radius but is normal platform behavior and not a standalone privilege escalation.
How to Use
  1. Make sure OpenClaw is installed (local or Docker)
  2. Run the install command in chat: /install cogdx-health
  3. After installation, invoke the skill by name or use /cogdx-health
  4. Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
Free cognitive health check. Real statistical analysis. Detects one specific reasoning pattern.
Metadata
Slug cogdx-health
Version 1.0.0
License MIT-0
All-time Installs 0
Active Installs 0
Total Versions 1
Frequently Asked Questions

What is CogDx Health Check (Free)?

Free cognitive health check for AI agents via Cerebratech CogDx. Use as entry point before committing to paid diagnostics. Agent sends 10-20 recent outputs w... It is an AI Agent Skill for Claude Code / OpenClaw, with 204 downloads so far.

How do I install CogDx Health Check (Free)?

Run "/install cogdx-health" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.

Is CogDx Health Check (Free) free?

Yes, CogDx Health Check (Free) is completely free, licensed under MIT-0. You can download, install and use it at no cost.

Which platforms does CogDx Health Check (Free) support?

CogDx Health Check (Free) is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).

Who created CogDx Health Check (Free)?

It is built and maintained by Dr Amanda Kavner (@drkavner); the current version is v1.0.0.

💬 Comments