Skip to content
Back to skills

Dev Loop Audit

ASecurity

Development loop audit for a repo - CI, git hooks and AI agent time over a week (GitHub Actions failures, flakes, holes on the main branch, slow jobs and billed minutes; local hooks and the pre-push gate; Claude Code's own waits, retries and simulator or browser checks), ranks every problem by minutes lost, keeps a trend, and asks which fixes to build. Use when someone asks why CI or the agent is slow or flaky, wants a CI or pipeline audit, or wants a weekly audit scheduled.

  • 5 stars
  • 0 votes
  • 0 copies
  • 0 views
  • Added November 17, 2026
developmentgobashnodegitapi

Works with

  • claude code
  • api

Security analysis

A100/100

Pro scans all 20 files and shows the line behind each finding

Scanned November 18, 2026

npx -y skills add matthewzammit/skills --skill dev-loop-audit --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Dev Loop Audit?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Dev Loop Audit
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/matthewzammit-dev-loop-audit/badge)](https://www.skillsdirectory.com/skills/matthewzammit-dev-loop-audit)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

Download with Pro
SKILL.md
---
name: dev-loop-audit
description: Development loop audit for a repo - CI, git hooks and AI agent time over a week (GitHub Actions failures, flakes, holes on the main branch, slow jobs and billed minutes; local hooks and the pre-push gate; Claude Code's own waits, retries and simulator or browser checks), ranks every problem by minutes lost, keeps a trend, and asks which fixes to build. Use when someone asks why CI or the agent is slow or flaky, wants a CI or pipeline audit, or wants a weekly audit scheduled.
argument-hint: "[setup | last week | last 7 days | YYYY-MM-DD YYYY-MM-DD]"
---

# Dev loop audit

Measure where the development loop lost time last week, rank every problem by **minutes lost**, prove the top
ones, and ask which fixes to build. Three areas, one ranking: **CI** (GitHub Actions), the **gate** (git hooks and
the checks people run before a push), and **agent time** (what Claude Code spent waiting, retrying and checking its
work on a simulator or in a browser). Agent time is often the biggest cost and the one nobody measures.
A fourth list asks where agent work is **not proven**: stamps on commits, checks re-run until green, a verify step.

Talk to the person in short, plain sentences, with a recommendation. Every number comes from a script or a
command; an estimate says "estimated". **Read-only until the person picks fixes**: the only files you write before
that are the record and the trend row.

Scripts (Node 18+, no installs) are in `${CLAUDE_SKILL_DIR}/scripts/`. Run them from the repo root. Put their
output in a scratch folder (`$OUT` below), never in the repo.

## 1. Setup (first run only)

If the repo has no dev-loop-audit config (`.dev-loop-audit/config.json`, or `~/.claude/dev-loop-audit/<repo>/config.json`), or
`$ARGUMENTS` is `setup`, follow [references/setup.md](references/setup.md), then stop if the argument was `setup`.

Done when: a config exists and says where records go, which workflows are CI, the add-ons, and how tickets are filed.

## 2. Window

From `$ARGUMENTS`: empty or "last week" is last Monday to this Monday (local time); "last 7 days" is `--days 7`;
two dates are `--from A --to B` (`--to` is the day after the last day). Run `date` first; never guess today.
Read the record folder's `trend.csv` and the last report, so you know last week's numbers and past fixes.

Done when: you can say the window in one line, and you have last week's row (or know this is the first run).

## 3. Measure

```bash
node ${CLAUDE_SKILL_DIR}/scripts/ci-runs.js <window> --out $OUT/ci.json > $OUT/ci.txt
node ${CLAUDE_SKILL_DIR}/scripts/repo-checks.js <window> --out $OUT/checks.json > $OUT/checks.txt
node ${CLAUDE_SKILL_DIR}/scripts/transcripts.js <window> --out $OUT/calls.json
node ${CLAUDE_SKILL_DIR}/scripts/metrics.js --calls $OUT/calls.json --ci $OUT/ci.json --checks $OUT/checks.json --out $OUT/metrics.json > $OUT/metrics.txt
```

`<window>` is the same options for each, one per argument (in zsh, an unquoted `$VAR` does not split: use an
array). `ci-runs.js` needs `gh` signed in; it checks the API rate limit first and says so if it is low.
`repo-checks.js` reads the files as they are now and lists the commits since the window end that changed workflows
or hooks: a finding one of them fixes is reported as "fixed since", not as open. If a script
misses a command shape this repo uses (its own helper scripts), add a tag to the config's `tags` and run again;
never write a second parser. Cross-check the busiest session: `transcripts.js <window> --check <session>`
counts its calls with a plain reader; the number equals its `calls` under Sessions in `metrics.txt`. (A grep of
the whole transcript counts other weeks, replays and subagents, so it is always higher.)

Agent time reads Claude Code transcripts only. When `transcripts.js` says "No transcript folders matched" (another
agent, or another machine), its zeros are not measurements: report agent time under "not checked", say why, and
audit CI and the gate as usual.

Done when: all four outputs exist, and the cross-check holds or you know why it differs.

## 4. Two loops, in parallel

Launch two agents at once (the Agent tool), each with [templates/loop-brief.md](templates/loop-brief.md) filled in:

- **Reliability**: what failed, what reached the main branch unchecked, what wasted runs or time, and where agent
  work is not proven (the verification list owns most of this).
- **Speed**: where the time went even when nothing failed, against the trend, and the biggest wins, including how
  long the verify step takes.

They read the outputs from step 3 and the check lists: [references/checks-ci.md](references/checks-ci.md),
[references/checks-local.md](references/checks-local.md), [references/checks-agent-time.md](references/checks-agent-time.md),
[references/checks-verification.md](references/checks-verification.md),
plus [references/addon-mobile.md](references/addon-mobile.md) and [references/addon-web.md](references/addon-web.md)
when the config turns those on. Each returns findings with evidence ids and minutes.

Done when: both loops have returned, and every item in the check lists that applies has a result (a finding,
"already right", or "not checked" with why).

## 5. Verify the top 5

For the five findings with the most minutes, across both loops, re-check the raw evidence yourself: open the run
(`gh run view <id> --log-failed`), re-count in `calls.json`, read the transcript lines by tool_use id. Try to prove
each one wrong. Drop or downgrade what does not hold, and say so in the report.

Done when: each of the five is "holds", "downgraded" (with the new number) or "dropped" (with why).

## 6. Record

1. Write the report from [templates/report.md](templates/report.md) to `<records>/<YYYY-MM-DD>.md` (the run's date),
   following [references/report.md](references/report.md).
2. Append the trend row: `node ${CLAUDE_SKILL_DIR}/scripts/metrics.js --calls $OUT/calls.json --ci $OUT/ci.json --checks $OUT/checks.json --append-trend <records>/trend.csv`.
3. If the config files tickets: follow its `tickets.how` exactly (its naming, its commands, which fixes get a ticket).
   Where it is silent: one parent named "Dev loop audit, YYYY-MM-DD" and one ticket per proposed fix under it.
   Never reuse an earlier run's parent.

Done when: the report and the row exist, and tickets are filed if the config asks for them.

## 7. Report and ask

Reply in the chat, short:

- Minutes lost per area (CI, gate, agent time), one line each, with the change from last week.
- What broke, most minutes first. What got slower or faster, most minutes first. What is already right.
- The proposed fixes, numbered, ranked by minutes saved a week, each marked Reliability or Speed and its area,
  with your pick. Each fix says what it does to both clocks: billed minutes and how long someone waits. A fix
  that cuts one and raises the other says so ("parallel jobs: 2 min less wait, +3 billed min a run").

Then ask: "Which should I build? Numbers, 'all' or 'none'." **Stop and wait.**

Done when: the person has the list and the question.

## If the person picks fixes

Build only those, on a new branch (`fix/dev-loop-audit-<date>`) from the main branch, one commit per fix, with the
repo's own checks green. A rule for agents (not code) goes in the repo's agent docs (`AGENTS.md`, `CLAUDE.md`).
A fix bigger than a day becomes a written plan instead of code. Open a pull request with the findings and what each
fix should change in next week's numbers. Never merge it. Add a line per fix to the report's "Built" section.

Files in this skill

  • README.md20.9 KB
  • SKILL.md7 KB
  • references/addon-mobile.md2.5 KB
  • references/addon-web.md1.7 KB
  • references/checks-agent-time.md5.2 KB
  • references/checks-ci.md10.3 KB
  • references/checks-local.md8.7 KB
  • references/report.md3.2 KB
  • references/setup.md5.4 KB
  • scripts/ci-runs.js30.5 KB
  • scripts/ci-runs.test.js16.3 KB
  • scripts/common.js13.8 KB
  • scripts/common.test.js5.9 KB
  • scripts/metrics.js27.1 KB
  • scripts/metrics.test.js10.4 KB
  • scripts/readme-checks.test.js1.3 KB
  • scripts/repo-checks.js27 KB
  • scripts/repo-checks.test.js9.5 KB
  • scripts/transcripts.js22.3 KB
  • scripts/transcripts.test.js12.4 KB

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

View all in development →

Comments

Loading comments…

Newsletter

Get the weekly list of safe new skills, and the ones we pulled.