Distinction Maximization Loss Efficiently Improving Outofdistribution Detection And Uncertainty Estimation By Replacing The Loss And Calibrating
ASecurity**arXiv ID:** 2205.05874 **Authors:** David Macêdo, Cleber Zanchettin, Teresa Ludermir **Published:** 2022-05-12T04:37:35Z **Abstract:** Building robust deterministic neural networks remains a challenge. On the one hand, some approaches improve out-of-distribution detection at the cost of reducing classification accuracy in some situations. On the other hand, some methods simultaneously increase classification accuracy, uncertainty estimation, and out-of-distribution detection at the expense ...
- 3 stars
- 0 votes
- 0 copies
- 1 view
- Added September 11, 2026
Security analysis
100/100npx -y skills add hiyenwong/ai_collection --skill distinction-maximization-loss-efficiently-improving-outofdistribution-detection-and-uncertainty-estimation-by-replacing-the-loss-and-calibrating --agent claude-codeAre you the author of Distinction Maximization Loss Efficiently Improving Outofdistribution Detection And Uncertainty Estimation By Replacing The Loss And Calibrating?
Add the live security badge to your README. It updates with every re-scan.
[](https://www.skillsdirectory.com/skills/hiyenwong-distinction-maximization-loss-efficiently-improvin)# Distinction Maximization Loss: Efficiently Improving Out-of-Distribution Detection and Uncertainty Estimation by Replacing the Loss and Calibrating
**arXiv ID:** 2205.05874
**Authors:** David Macêdo, Cleber Zanchettin, Teresa Ludermir
**Published:** 2022-05-12T04:37:35Z
**Abstract:**
Building robust deterministic neural networks remains a challenge. On the one hand, some approaches improve out-of-distribution detection at the cost of reducing classification accuracy in some situations. On the other hand, some methods simultaneously increase classification accuracy, uncertainty estimation, and out-of-distribution detection at the expense of reducing the inference efficiency. In this paper, we propose training deterministic neural networks using our DisMax loss, which works as a drop-in replacement for the usual SoftMax loss (i.e., the combination of the linear output layer, the SoftMax activation, and the cross-entropy loss). Starting from the IsoMax+ loss, we create each logit based on the distances to all prototypes, rather than just the one associated with the correct class. We also introduce a mechanism to combine images to construct what we call fractional probability regularization. Moreover, we present a fast way to calibrate the network after training. Finally, we propose a composite score to perform out-of-distribution detection. Our experiments show that DisMax usually outperforms current approaches simultaneously in classification accuracy, uncertainty estimation, and out-of-distribution detection while maintaining deterministic neural network inference efficiency. The code to reproduce the results is available at https://github.com/dlmacedo/distinction-maximization-loss.
## Skill Description
This skill is generated from the arXiv paper: Distinction Maximization Loss: Efficiently Improving Out-of-Distribution Detection and Uncertainty Estimation by Replacing the Loss and Calibrating (2205.05874).
## How to Use
[To be filled in by the user or by future automation]
## References
- [arXiv:2205.05874](http://arxiv.org/abs/2205.05874v5)
Attribution
Related skills
View all in tools →Comments
Loading comments…
Newsletter
Get the weekly list of safe new skills, and the ones we pulled.