Compute ROC sweep for the quality_score pass threshold. Math-only — opens a recommendation queue row; never changes the live threshold.
Scanned 9/3/2026
Install to Claude Code
npx -y skills add mat-lucie/outbound-sales-agent --skill threshold-calibration --agent claude-codeInstalls into .claude/skills of the current project.
Are you the author of Threshold Calibration?
Add the live security badge to your README — it updates automatically with every re-scan.
[](https://www.skillsdirectory.com/skills/mat-lucie-threshold-calibration)More formats (shields.io, HTML) on the badges page.
---
name: threshold-calibration
description: Compute ROC sweep for the quality_score pass threshold. Math-only — opens a recommendation queue row; never changes the live threshold.
---
# /threshold-calibration
Operator runs this weekly (Sunday cadence recommended, after
`/data-quality-report`). Replaces the 06:30 Sunday cron. Pure Attio
read + numpy/scipy ROC math; zero LLM cost.
Ships in PR-45.5 — until then this skill prints a "not yet shipped"
message and exits.
## Step 0 — Verify Attio MCP scope
Same as `/sales-daily`.
## Step 1 — Run the calibration
```bash
sales threshold-calibration
```
Options:
- `--dry-run` — print the ROC table without opening the recommendation
queue row.
## Output
The script:
1. Queries LinkedIn Outreach for labeled prospects (stage ∈ {QUALIFIED,
CALL_BOOKED, NOT_INTERESTED, RESPONDED} AND `response_classification
∈ {positive, defensive}` AND `quality_score IS NOT NULL`).
2. Sweeps thresholds 40..80 step 5; computes max-Youden + cost-weighted
recommendations.
3. Opens a `threshold_recommendation` queue row with the ROC table.
## Abstain semantics
When `n_labeled < 50`, the function returns `{"status": "abstain"}`
and opens a `threshold_recommendation_insufficient_data` row. The
operator sees the abstain explicitly — never silently skipped.
## Operator decision
The script NEVER changes the live threshold in `quality_gate.score_prospect`.
The recommendation queue row is for operator confirmation; a separate
PR is required to flip the threshold in code.
Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.
No comments yet. Be the first to comment!