Skip to content
Back to skills

Changeset Validation

ASecurity

Validate changesets in openai-agents-js using LLM judgment against git diffs (including uncommitted local changes). Use when packages/ or .changeset/ are modified, or when verifying PR changeset compliance and bump level.

  • 2 stars
  • 0 votes
  • 1 copy
  • 6 views
  • Added October 26, 2026
ai-agentsbashgit

Security analysis

A100/100

Pro scans all 7 files and shows the line behind each finding

Scanned October 26, 2026

npx -y skills add JoshuaShepherd/my-skills --skill changeset-validation --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Changeset Validation?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Changeset Validation
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/joshuashepherd-changeset-validation/badge)](https://www.skillsdirectory.com/skills/joshuashepherd-changeset-validation)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

Download with Pro
SKILL.md
---
name: changeset-validation
description: Validate changesets in openai-agents-js using LLM judgment against git diffs (including uncommitted local changes). Use when packages/ or .changeset/ are modified, or when verifying PR changeset compliance and bump level.
---

# Changeset Validation

## Overview

This skill validates whether changesets correctly reflect package changes and follow the repository rules. It relies on the shared prompt in `references/validation-prompt.md` so local Codex reviews and GitHub Actions share the same logic.
Experimental or preview-only feature additions that are explicitly labeled as such in the diff may remain a patch bump when they do not change existing behavior.
Major bumps are only allowed after the first major release; before that, do not use major bumps for feature-level changes.

## Quick start

Local (Codex-driven):

1. Run:
   ```bash
   pnpm changeset:validate-prompt
   ```
2. Apply the rules from `references/validation-prompt.md` to the generated prompt.
3. Respond with a JSON verdict containing ok/errors/warnings/required_bump (English-only strings).

CI (Codex Action):

1. Run:
   ```bash
   pnpm changeset:validate-prompt -- --ci --output .github/codex/prompts/changeset-validation.generated.md
   ```
2. Use `openai/codex-action` with the generated prompt and JSON schema to get a structured verdict.

## Workflow

1. Generate the prompt context via `pnpm changeset:validate-prompt`.
2. Apply the rules in `references/validation-prompt.md` to judge correctness.
3. Provide a clear verdict and required bump (patch/minor/major/none).
4. If the changeset needs edits, update it and re-run the validation.

## Branch-level changeset rule (do not skip)

- If any `.changeset/*.md` file is already present in the current branch diff, treat it as the active changeset. **Do not add a new changeset file.**
- Instead, **update the existing changeset file** by rewriting its summary to reflect the **primary change relative to `main`**. Do not try to capture every incremental update.
- Keep the summary at **one line**; replace the line as needed rather than appending. If you must include multiple points, compress them into a single line.

## Shared source of truth

- Keep the prompt file as the single source of validation rules.
- Keep the script lightweight: it should only gather context and emit the prompt.

## Resources

- `references/validation-prompt.md`

Files in this skill

  • SKILL.md2.4 KB
  • agents/openai.yaml276 B
  • references/validation-prompt.md4.4 KB
  • scripts/changeset-assign-milestone.mjs4.6 KB
  • scripts/changeset-prompt.mjs14 KB
  • scripts/changeset-validation-result.mjs1.7 KB
  • scripts/run-fixtures.sh1.6 KB

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

Comments

Loading comments…

Newsletter

Get the weekly list of safe new skills, and the ones we pulled.