Skip to content
Back to skills

Reference Summary Checks

ASecurity

Load posteriordb reference posterior summaries and validate numeric quality fields for benchmark targets.

  • 247 stars
  • 0 votes
  • 0 copies
  • 2 views
  • Added September 9, 2026
testingpythondatabase

Security analysis

A100/100

Pro scans all 3 files and shows the line behind each finding

Scanned September 9, 2026

npx -y skills add VectorSpaceLab/AREX-Skill --skill reference_summary_checks --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Reference Summary Checks?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Reference Summary Checks
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/vectorspacelab-reference-summary-checks/badge)](https://www.skillsdirectory.com/skills/vectorspacelab-reference-summary-checks)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

Download with Pro
SKILL.md
---
name: reference_summary_checks
description: Load posteriordb reference posterior summaries and validate numeric quality fields for benchmark targets.
---

# Reference Summary Checks

Use this skill when a benchmark needs deterministic reference posterior summaries, especially posterior means and optional MCSE values, from a posteriordb-style snapshot. Do not use it to certify full MCMC quality when only summary files are available.

## Inputs

- `summary_path`: JSON file containing parameter names and numeric summary values.
- Optional `reference_info_path`: JSON metadata describing the reference posterior source and diagnostics.
- Optional `statistic`: summary vector key, defaulting to `mean_value`.

## Outputs

- A JSON report with `valid`, `statistic`, `values`, `mcse`, `quality_flags`, and `blockers`.
- Vector consistency and finite-number checks suitable for downstream scoring.

## Workflow

1. Parse the summary JSON and locate `names` plus the requested statistic vector.
2. Validate equal vector lengths and finite numeric values.
3. Attach MCSE values when `mcse_<statistic>` or `mcse_mean` is available with matching length.
4. Inspect reference-info metadata conservatively and record whether diagnostics are present.
5. Return blockers instead of inventing missing reference targets.

## Validation

Run `python scripts/reference_summary.py --summary <file> --output summary_report.json` or the included tests through `validate_skill_tree.py --run-tests`.

## Limitations

Summary schemas vary across databases. This skill focuses on deterministic summary loading and does not rerun reference samplers, compute R-hat, or download draw archives.

Files in this skill

  • SKILL.md1.6 KB
  • scripts/reference_summary.py3 KB
  • tests/test_reference_summary.py808 B

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

Comments

Loading comments…

Newsletter

Get the weekly list of safe new skills, and the ones we pulled.