Sensitivityaware Mixedprecision Quantization And Width Optimization Of Deep Neural Networks Through Clusterbased Treestructured Parzen Estimation
ASecurity**arXiv ID:** 2308.06422 **Authors:** Seyedarmin Azizi, Mahdi Nazemi, Arash Fayyazi, Massoud Pedram **Published:** 2023-08-12T00:16:51Z **Abstract:** As the complexity and computational demands of deep learning models rise, the need for effective optimization methods for neural network designs becomes paramount. This work introduces an innovative search mechanism for automatically selecting the best bit-width and layer-width for individual neural network layers. This leads to a marked enhance...
- 3 stars
- 0 votes
- 0 copies
- 3 views
- Added September 11, 2026
Security analysis
100/100npx -y skills add hiyenwong/ai_collection --skill sensitivityaware-mixedprecision-quantization-and-width-optimization-of-deep-neural-networks-through-clusterbased-treestructured-parzen-estimation --agent claude-codeAre you the author of Sensitivityaware Mixedprecision Quantization And Width Optimization Of Deep Neural Networks Through Clusterbased Treestructured Parzen Estimation?
Add the live security badge to your README. It updates with every re-scan.
[](https://www.skillsdirectory.com/skills/hiyenwong-sensitivityaware-mixedprecision-quantization-and-w)# Sensitivity-Aware Mixed-Precision Quantization and Width Optimization of Deep Neural Networks Through Cluster-Based Tree-Structured Parzen Estimation
**arXiv ID:** 2308.06422
**Authors:** Seyedarmin Azizi, Mahdi Nazemi, Arash Fayyazi, Massoud Pedram
**Published:** 2023-08-12T00:16:51Z
**Abstract:**
As the complexity and computational demands of deep learning models rise, the need for effective optimization methods for neural network designs becomes paramount. This work introduces an innovative search mechanism for automatically selecting the best bit-width and layer-width for individual neural network layers. This leads to a marked enhancement in deep neural network efficiency. The search domain is strategically reduced by leveraging Hessian-based pruning, ensuring the removal of non-crucial parameters. Subsequently, we detail the development of surrogate models for favorable and unfavorable outcomes by employing a cluster-based tree-structured Parzen estimator. This strategy allows for a streamlined exploration of architectural possibilities and swift pinpointing of top-performing designs. Through rigorous testing on well-known datasets, our method proves its distinct advantage over existing methods. Compared to leading compression strategies, our approach records an impressive 20% decrease in model size without compromising accuracy. Additionally, our method boasts a 12x reduction in search time relative to the best search-focused strategies currently available. As a result, our proposed method represents a leap forward in neural network design optimization, paving the way for quick model design and implementation in settings with limited resources, thereby propelling the potential of scalable deep learning solutions.
## Skill Description
This skill is generated from the arXiv paper: Sensitivity-Aware Mixed-Precision Quantization and Width Optimization of Deep Neural Networks Through Cluster-Based Tree-Structured Parzen Estimation (2308.06422).
## How to Use
[To be filled in by the user or by future automation]
## References
- [arXiv:2308.06422](http://arxiv.org/abs/2308.06422v3)
Attribution
Related skills
View all in tools →Comments
Loading comments…
Newsletter
Get the weekly list of safe new skills, and the ones we pulled.