Multi Label Toxicity Detection Eval

---
name: multi-label-toxicity-detection-eval
description: Evaluates an LLM's ability to identify multiple concurrent toxicity categories in real-world prompts using a fine-grained 15-category taxonomy. It probes fine-grained safety alignment, multi-label classification under ambiguous annotations, and the model's robustness to sparse or noisy supervision signals. Use when the user wants to benchmark on Q-A-MLL, H-X-MLL, R-A-MLL, or asks about evaluating this task. Reports mean Average Precision.
metadata:
  skill_kind: dataset_eval
  source_arxiv: 2510.15007
  bibtex_key: kou2025rethinking
  confidence: high
---

# multi-label-toxicity-detection-eval

> Rethinking Toxicity Evaluation in Large Language Models: A Multi-Label Perspective — Kou et al. (2025) (arXiv:2510.15007, 2025)

## What this evaluates

Evaluates an LLM's ability to identify multiple concurrent toxicity categories in real-world prompts using a fine-grained 15-category taxonomy. It probes fine-grained safety alignment, multi-label classification under ambiguous annotations, and the model's robustness to sparse or noisy supervision signals.

## Datasets

- **Q-A-MLL** — total ?; splits: test (-1)
- **H-X-MLL** — total ?; splits: test (-1)
- **R-A-MLL** — total ?; splits: test (-1)

## Metrics

- `mean Average Precision` **(primary)** — range: [0, 1]
  - Computes the Average Precision (AP) for each of the 15 toxicity labels independently, then averages the APs across all labels. Ranges from 0 to 1, where higher values indicate better precision-recall trade-offs across labels.
- `Label Ranking Loss` — range: [0, 1]
  - Measures the average fraction of pairwise swaps needed to rank all positive labels above all negative labels for each instance. Ranges from 0 to 1, where lower values indicate better label ordering.

## Input / output format

**Input**: Raw text prompts (toxic or benign) requiring multi-label toxicity classification.

**Output**: Binary label vector of length 15, where each element indicates the presence (1) or absence (0) of a specific toxicity category.

## Scoring recipe

```python
def compute_metrics(y_true, y_pred):
    # y_true, y_pred: (N, 15) binary matrices
    aps = []
    for k in range(15):
        tp = (y_pred[:, k] == 1) & (y_true[:, k] == 1)
        fp = (y_pred[:, k] == 1) & (y_true[:, k] == 0)
        precisions = np.cumsum(tp) / np.arange(1, len(tp)+1)
        aps.append(np.mean(precisions[tp]))
    mAP = np.mean(aps)
    pos = y_true == 1
    neg = y_true == 0
    lrl_vals = []
    for i in range(len(y_true)):
        if pos[i].sum() == 0 or neg[i].sum() == 0:
            lrl_vals.append(0.0)
        else:
            swaps = np.sum(y_pred[i, pos[i]] < y_pred[i, neg[i]])
            lrl_vals.append(swaps / (pos[i].sum() * neg[i].sum()))
    LRL = np.mean(lrl_vals)
    return mAP, LRL
```

## Common pitfalls

- Assuming toxicity is mutually exclusive (single-label) when real-world prompts inherently violate multiple safety criteria simultaneously.
- Treating annotator disagreement as pure noise instead of modeling it as label ambiguity or missing labels.
- Evaluating LLMs without post-processing their free-text outputs into fixed binary label vectors before scoring.

## Evidence (verbatim from paper)

> Table 2: We present comparative results on three datasets (H-X-MLL, Q-A-MLL, and R-A-MLL) with three backbone models (DeepSeek, GPT, and RoBERTa), evaluated by mean Average Precision (↑) and Label Ranking Loss (↓).

## Citation

```bibtex
@misc{kou2025rethinking,
  title={Rethinking Toxicity Evaluation in Large Language Models: A Multi-Label Perspective},
  author={Kou et al. (2025)},
  year={2025},
  note={arXiv:2510.15007}
}
```

- arXiv: 2510.15007