Skip to content
Back to skills

Tuning Detections To Reduce False Positives

ASecurity

'Tunes noisy detections by analyzing historical alert data to quantify false-positive

  • 22 stars
  • 0 votes
  • 0 copies
  • 3 views
  • Added September 11, 2026
securitypythonbashgitapisecurity

Works with

  • api

Security analysis

A100/100

Pro scans all 4 files and shows the line behind each finding

Scanned September 11, 2026

npx -y skills add meltedinhex/analyst-ai-pack --skill tuning-detections-to-reduce-false-positives --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Tuning Detections To Reduce False Positives?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Tuning Detections To Reduce False Positives
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/meltedinhex-tuning-detections-to-reduce-false-positives/badge)](https://www.skillsdirectory.com/skills/meltedinhex-tuning-detections-to-reduce-false-positives)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

Download with Pro
SKILL.md
---
name: tuning-detections-to-reduce-false-positives
description: 'Tunes noisy detections by analyzing historical alert data to quantify false-positive
  sources, recommend allow-list filters and threshold adjustments, and measure precision impact.
  Activates for requests to tune a detection, reduce false positives, or analyze alert noise and
  recommend filters.'
domain: cybersecurity
subdomain: threat-hunting
tags:
  - threat-hunting
  - detection-engineering
  - false-positives
  - tuning
  - alert-triage
version: 1.0.0
author: analyst-ai-pack
license: Apache-2.0
mitre_attack:
  - T1059
  - T1071
  - T1053
d3fend:
  - D3-PSA
  - D3-NTA
references:
  - 'Sigma rule specification (filters/condition) — https://github.com/SigmaHQ/sigma-specification'
  - 'Detection engineering precision/recall concepts — https://attack.mitre.org/resources/'
---

# Tuning Detections to Reduce False Positives

## When to Use

- A detection generates excessive false positives and you want a data-driven tuning plan: which
  fields/values drive the noise, what filters to add, and the precision impact.
- You are balancing recall against alert fatigue.

**Do not use** tuning that suppresses true positives — filters must target benign noise, not the
malicious pattern. Always estimate the impact on true positives before applying.

## Prerequisites

- Labeled alert history (CSV/JSON) with at least an outcome/label field (true_positive vs
  false_positive) and the alert's distinguishing fields.

## Workflow

### Step 1: Quantify false-positive sources

```bash
python scripts/analyst.py analyze alerts.csv --label verdict --field ParentImage
```

Ranks field values by how much false-positive volume they drive and computes current
precision/false-positive rate.

### Step 2: Recommend filters

Suggest allow-list filters for values that are overwhelmingly benign (high FP, no/low TP), with the
projected precision gain.

### Step 3: Estimate impact

Report how many true positives would be lost (should be zero/near-zero for safe filters).

### Step 4: Apply and monitor

Add the safe filters to the rule's `filter`/exclusion and continue monitoring precision.

## Validation

- FP-driving values are ranked by their false-positive contribution.
- Recommended filters target values with negligible true-positive loss.
- Projected precision and TP-loss are reported.

## Pitfalls

- Filtering a value that also carries true positives, blinding the detection.
- Over-fitting to one time window's noise.
- Tuning by gut feel instead of measured FP/TP contribution.

## References

- See [`references/api-reference.md`](references/api-reference.md) for the tuner.
- Sigma spec and detection-engineering references (linked in frontmatter).

Files in this skill

  • LICENSE340 B
  • SKILL.md2.7 KB
  • references/api-reference.md1.3 KB
  • scripts/analyst.py3.1 KB

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

Comments

Loading comments…

Newsletter

Get the weekly list of safe new skills, and the ones we pulled.