Run an auditable reduced recovery experiment for the SBI benchmark by composing generated task, sampling, and C2ST skills.
Scanned 9/9/2026
Install to Claude Code
npx -y skills add VectorSpaceLab/AREX-Skill --skill benchmark_recovery_harness --agent claude-codeInstalls into .claude/skills of the current project.
Are you the author of Benchmark Recovery Harness?
Add the live security badge to your README — it updates automatically with every re-scan.
[](https://www.skillsdirectory.com/skills/vectorspacelab-benchmark-recovery-harness-9bb05483)More formats (shields.io, HTML) on the badges page.
---
name: benchmark_recovery_harness
description: Run an auditable reduced recovery experiment for the SBI benchmark by composing generated task, sampling, and C2ST skills.
---
# Benchmark Recovery Harness
Use this skill after the SBI benchmark module skills have been generated and validated. It writes recovery artifacts that prove the task protocol, posterior sampling, and C2ST metric were exercised without reading the original repository during recovery.
## Inputs
- Attempt directory containing `module_plan.json` and `environment/runtime_handoff.json`.
- Generated skills root containing `sbibm_task_protocol`, `posterior_sampling_baseline`, and `c2st_metric_evaluation`.
- Sample count, seed, and approximation mode.
## Outputs
- `recovery/recovery_result.json`, command-compatible logs, generated data item, training trace, source manifest, and invocation log.
## Workflow
1. Read the module plan target and runtime handoff.
2. Call the task protocol script to construct a Gaussian Linear proxy item.
3. Call the posterior sampling script to draw reference and approximate samples.
4. Call the C2ST metric script to compute the proxy metric.
5. Write mechanism checks proving reduced training/proxy execution, optimizer-like parameter update evidence, and source-boundary compliance.
## Validation
Run the harness, then run `recover-paper/scripts/validate_recovery_experiment.py` on the attempt directory.
## Limitations
This is a soft-mode reduced recovery harness. It must not be presented as a full paper reproduction across all tasks, algorithms, and budgets.
## Refinement Note
A shifted-posterior ablation should raise C2ST above the acceptance threshold; keep matched and shifted modes available for sanity checks.
Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.
No comments yet. Be the first to comment!