← Back to Skills Marketplace
GitHub Actions Step Flake Audit
by
Daniel Lummis
· GitHub ↗
· v1.0.0
244
Downloads
0
Stars
1
Active Installs
1
Versions
Install in OpenClaw
/install github-actions-step-flake-audit
Description
Detect flaky GitHub Actions job steps by finding mixed success/failure conclusions across runs.
README (SKILL.md)
GitHub Actions Step Flake Audit
Use this skill to catch flaky CI steps that alternate between passing and failing across workflow runs.
What this skill does
- Reads GitHub Actions run JSON exports (
gh run view --json ...) - Groups step outcomes by repository + workflow + job + step name
- Scores each step for flake risk when both success and failure outcomes are present
- Ranks the most unstable steps by failure rate and failed-run volume
- Supports text/json outputs and optional fail gate for CI enforcement
Inputs
Optional:
RUN_GLOB(default:artifacts/github-actions/*.json)TOP_N(default:20)OUTPUT_FORMAT(textorjson, default:text)MIN_OCCURRENCES(default:3) — minimum observed step runs before scoringWARN_FAILURE_RATE(default:0.20) — flaky failure-rate thresholdCRITICAL_FAILURE_RATE(default:0.40) — critical flaky failure-rate thresholdFAIL_ON_CRITICAL(0or1, default:0)REPO_MATCH/REPO_EXCLUDE(regex, optional)WORKFLOW_MATCH/WORKFLOW_EXCLUDE(regex, optional)JOB_MATCH/JOB_EXCLUDE(regex, optional)STEP_MATCH/STEP_EXCLUDE(regex, optional)
Collect run JSON
gh run view \x3Crun-id> --json databaseId,workflowName,headBranch,headSha,url,repository,jobs \
> artifacts/github-actions/run-\x3Crun-id>.json
Run
Text report:
RUN_GLOB='artifacts/github-actions/*.json' \
MIN_OCCURRENCES=5 \
WARN_FAILURE_RATE=0.15 \
CRITICAL_FAILURE_RATE=0.35 \
bash skills/github-actions-step-flake-audit/scripts/step-flake-audit.sh
JSON output + fail gate:
RUN_GLOB='artifacts/github-actions/*.json' \
OUTPUT_FORMAT=json \
FAIL_ON_CRITICAL=1 \
bash skills/github-actions-step-flake-audit/scripts/step-flake-audit.sh
Run against bundled fixtures:
RUN_GLOB='skills/github-actions-step-flake-audit/fixtures/*.json' \
bash skills/github-actions-step-flake-audit/scripts/step-flake-audit.sh
Output contract
- Exit
0in reporting mode (default) - Exit
1whenFAIL_ON_CRITICAL=1and one or more flaky step groups are critical - Text mode prints summary + top flaky steps
- JSON mode prints summary + ranked groups + critical groups
Usage Guidance
This skill analyzes local GitHub Actions run JSON exports and does not send data out or require credentials. Before running: 1) ensure RUN_GLOB points only to intended artifact files (avoid broad globs that might match sensitive JSON), 2) if you want to collect runs using the `gh` example in SKILL.md, run that yourself — the skill does not call `gh` and does not declare it as a dependency, and 3) inspect any real run JSONs to confirm they don't contain sensitive secrets you don't want processed or stored. Otherwise the tool appears coherent and appropriate for its stated purpose.
Capability Analysis
Type: OpenClaw Skill
Name: github-actions-step-flake-audit
Version: 1.0.0
The skill is designed to identify flaky GitHub Actions steps by parsing JSON run logs. The implementation in `step-flake-audit.sh` uses a Python script to safely aggregate job outcomes and calculate failure rates without any evidence of data exfiltration, unauthorized execution, or malicious intent.
Capability Assessment
Purpose & Capability
The name/description match the implementation: the script aggregates step outcomes from GitHub Actions run JSON files and scores flaky steps. Small mismatch: SKILL.md shows how to obtain JSON with `gh run view`, but the skill does not declare `gh` as a required binary or try to call `gh` itself — it only reads pre-collected JSON files. This is a minor documentation vs. requirement inconsistency, not a functional problem.
Instruction Scope
Runtime instructions and the script operate on local JSON files (RUN_GLOB) and only inspect fields in those files. The script reads, parses, filters, aggregates, and prints results or exits non-zero when FAIL_ON_CRITICAL is set. It does not attempt to read other system files, access network endpoints, or export data externally.
Install Mechanism
There is no install spec (instruction-only plus a bundled script), so nothing is downloaded or installed by the skill. Required binaries are minimal (bash, python3) and match the provided script.
Credentials
The skill requests no environment variables or credentials. It accepts many optional runtime variables (regex filters, thresholds) which are reasonable for its purpose. There are no secret-like env vars declared or accessed.
Persistence & Privilege
The skill does not request persistent presence (always:false) and does not modify agent system configuration. It runs as a one-off script operating on files the user supplies.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install github-actions-step-flake-audit - After installation, invoke the skill by name or use
/github-actions-step-flake-audit - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
Initial release
Metadata
Frequently Asked Questions
What is GitHub Actions Step Flake Audit?
Detect flaky GitHub Actions job steps by finding mixed success/failure conclusions across runs. It is an AI Agent Skill for Claude Code / OpenClaw, with 244 downloads so far.
How do I install GitHub Actions Step Flake Audit?
Run "/install github-actions-step-flake-audit" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is GitHub Actions Step Flake Audit free?
Yes, GitHub Actions Step Flake Audit is completely free (open-source). You can download, install and use it at no cost.
Which platforms does GitHub Actions Step Flake Audit support?
GitHub Actions Step Flake Audit is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created GitHub Actions Step Flake Audit?
It is built and maintained by Daniel Lummis (@daniellummis); the current version is v1.0.0.
More Skills