Skip to content
Back to skills

Intervention Comparison Matrix

ASecurity

Compare robustness interventions across clean and shifted metrics using direction-aware evidence signs.

  • 247 stars
  • 0 votes
  • 0 copies
  • 0 views
  • Added September 9, 2026
testingpython

Security analysis

A100/100

Scanned September 9, 2026

npx -y skills add VectorSpaceLab/AREX-Skill --skill intervention_comparison_matrix --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Intervention Comparison Matrix?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Intervention Comparison Matrix
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/vectorspacelab-intervention-comparison-matrix/badge)](https://www.skillsdirectory.com/skills/vectorspacelab-intervention-comparison-matrix)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

SKILL.md
---
name: intervention_comparison_matrix
description: Compare robustness interventions across clean and shifted metrics using direction-aware evidence signs.
---

# Intervention Comparison Matrix

Use this skill to summarize robustness interventions in the style of the paper's tables: each method is compared against a baseline on clean and shifted metrics, and improvements are interpreted according to whether the metric is error or accuracy.

## Inputs
- A list of metric rows with an `intervention` name and dataset metric values.
- The baseline intervention name.
- Metric direction: lower-is-better for error, higher-is-better for accuracy.

## Outputs
- Direction-aware deltas for each intervention and dataset.
- Evidence signs showing improvement, regression, or tie.
- The best shifted intervention when the target dataset is supplied.

## Workflow
1. Locate the baseline row.
2. For every intervention, compute signed improvements for available datasets.
3. Mark missing values as unavailable rather than zero.
4. Report the strongest intervention for the chosen shifted metric and whether the clean/shift gap narrows.

## Validation
Run `python tests/test_matrix.py` or the Distiller tree validator.

## Limitations
This skill analyzes metric tables; it does not judge whether the datasets themselves are representative.

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

Comments

Loading comments…

Newsletter

Get the weekly list of safe new skills, and the ones we pulled.