**arXiv ID:** 1711.05136 **Authors:** Guillaume Bellec, David Kappel, Wolfgang Maass, Robert Legenstein **Published:** 2017-11-14T15:02:47Z **Abstract:** Neuromorphic hardware tends to pose limits on the connectivity of deep networks that one can run on them. But also generic hardware and software implementations of deep learning run more efficiently for sparse networks. Several methods exist for pruning connections of a neural network after it was trained without connectivity constraints. We...
Installs into .claude/skills of the current project.
Sponsors
SSkills DirectorySkills Directory
Know which skills are safe — weekly.
SSkills DirectorySkills Directory
Is that skill safe to install?
Are you the author of Deep Rewiring Training Very Sparse Deep Networks?
Add the live security badge to your README. It updates with every re-scan.
[](https://www.skillsdirectory.com/skills/hiyenwong-deep-rewiring-training-very-sparse-deep-networks)
# Deep Rewiring: Training very sparse deep networks
**arXiv ID:** 1711.05136
**Authors:** Guillaume Bellec, David Kappel, Wolfgang Maass, Robert Legenstein
**Published:** 2017-11-14T15:02:47Z
**Abstract:**
Neuromorphic hardware tends to pose limits on the connectivity of deep networks that one can run on them. But also generic hardware and software implementations of deep learning run more efficiently for sparse networks. Several methods exist for pruning connections of a neural network after it was trained without connectivity constraints. We present an algorithm, DEEP R, that enables us to train directly a sparsely connected neural network. DEEP R automatically rewires the network during supervised training so that connections are there where they are most needed for the task, while its total number is all the time strictly bounded. We demonstrate that DEEP R can be used to train very sparse feedforward and recurrent neural networks on standard benchmark tasks with just a minor loss in performance. DEEP R is based on a rigorous theoretical foundation that views rewiring as stochastic sampling of network configurations from a posterior.
## Skill Description
This skill is generated from the arXiv paper: Deep Rewiring: Training very sparse deep networks (1711.05136).
## How to Use
[To be filled in by the user or by future automation]
## References
- [arXiv:1711.05136](http://arxiv.org/abs/1711.05136v5)