Skip to content
Back to skills

Posterior Accuracy Metrics

ASecurity

Compute posterior moment accuracy metrics for approximate draws against reference posterior summaries.

  • 247 stars
  • 0 votes
  • 0 copies
  • 3 views
  • Added September 9, 2026
businesspythonrustaws

Security analysis

A100/100

Pro scans all 3 files and shows the line behind each finding

Scanned September 9, 2026

npx -y skills add VectorSpaceLab/AREX-Skill --skill posterior_accuracy_metrics --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Posterior Accuracy Metrics?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Posterior Accuracy Metrics
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/vectorspacelab-posterior-accuracy-metrics/badge)](https://www.skillsdirectory.com/skills/vectorspacelab-posterior-accuracy-metrics)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

Download with Pro
SKILL.md
---
name: posterior_accuracy_metrics
description: Compute posterior moment accuracy metrics for approximate draws against reference posterior summaries.
---

# Posterior Accuracy Metrics

Use this skill when approximate posterior draws or estimates must be scored against posteriordb reference summaries. It is appropriate for reduced recovery experiments because it preserves the paper's moment-accuracy mechanism without requiring full Stan sampling.

## Inputs

- Approximate draws as a list of records, a dictionary of parameter arrays, or precomputed parameter means.
- Reference mean values keyed by parameter name.
- Optional squared-moment references keyed by parameter name.

## Outputs

- `mean_rmse`, `per_parameter` errors, parameter overlap, missing approximate parameters, and optional `squared_moment_rmse`.
- JSON suitable for recovery-result metrics and ablation checks.

## Workflow

1. Normalize approximate inputs into parameter arrays or means.
2. Intersect approximate and reference parameter names.
3. Compute signed mean errors and RMSE over the overlap.
4. Compute squared-moment RMSE separately when squared references are supplied.
5. Return missing-name accounting instead of silently treating absent parameters as zero.

## Validation

Run `python scripts/accuracy_metrics.py --approx approx.json --reference ref.json --output metrics.json` or the included tests via `validate_skill_tree.py --run-tests`.

## Limitations

This skill does not decide whether a reference summary is trustworthy. Pair it with the reference-summary skill for quality checks and with a benchmark harness for provenance and cost reporting.

Files in this skill

  • SKILL.md1.6 KB
  • scripts/accuracy_metrics.py3.5 KB
  • tests/test_accuracy_metrics.py421 B

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

Comments

Loading comments…

Newsletter

Get the weekly list of safe new skills, and the ones we pulled.