Lls Local Learning Rule For Deep Neural Networks Inspired By Neural Activity Synchronization
ASecurity**arXiv ID:** 2405.15868 **Authors:** Marco Paul E. Apolinario, Arani Roy, Kaushik Roy **Published:** 2024-05-24T18:24:24Z **Abstract:** Training deep neural networks (DNNs) using traditional backpropagation (BP) presents challenges in terms of computational complexity and energy consumption, particularly for on-device learning where computational resources are limited. Various alternatives to BP, including random feedback alignment, forward-forward, and local classifiers, have been explored ...
- 3 stars
- 0 votes
- 0 copies
- 1 view
- Added September 11, 2026
Security analysis
100/100npx -y skills add hiyenwong/ai_collection --skill lls-local-learning-rule-for-deep-neural-networks-inspired-by-neural-activity-synchronization --agent claude-codeAre you the author of Lls Local Learning Rule For Deep Neural Networks Inspired By Neural Activity Synchronization?
Add the live security badge to your README. It updates with every re-scan.
[](https://www.skillsdirectory.com/skills/hiyenwong-lls-local-learning-rule-for-deep-neural-networks-i)# LLS: Local Learning Rule for Deep Neural Networks Inspired by Neural Activity Synchronization
**arXiv ID:** 2405.15868
**Authors:** Marco Paul E. Apolinario, Arani Roy, Kaushik Roy
**Published:** 2024-05-24T18:24:24Z
**Abstract:**
Training deep neural networks (DNNs) using traditional backpropagation (BP) presents challenges in terms of computational complexity and energy consumption, particularly for on-device learning where computational resources are limited. Various alternatives to BP, including random feedback alignment, forward-forward, and local classifiers, have been explored to address these challenges. These methods have their advantages, but they can encounter difficulties when dealing with intricate visual tasks or demand considerable computational resources. In this paper, we propose a novel Local Learning rule inspired by neural activity Synchronization phenomena (LLS) observed in the brain. LLS utilizes fixed periodic basis vectors to synchronize neuron activity within each layer, enabling efficient training without the need for additional trainable parameters. We demonstrate the effectiveness of LLS and its variations, LLS-M and LLS-MxM, on multiple image classification datasets, achieving accuracy comparable to BP with reduced computational complexity and minimal additional parameters. Specifically, LLS achieves comparable performance with up to $300 \times$ fewer multiply-accumulate (MAC) operations and half the memory requirements of BP. Furthermore, the performance of LLS on the Visual Wake Word (VWW) dataset highlights its suitability for on-device learning tasks, making it a promising candidate for edge hardware implementations.
## Skill Description
This skill is generated from the arXiv paper: LLS: Local Learning Rule for Deep Neural Networks Inspired by Neural Activity Synchronization (2405.15868).
## How to Use
[To be filled in by the user or by future automation]
## References
- [arXiv:2405.15868](http://arxiv.org/abs/2405.15868v2)
Attribution
Related skills
View all in tools →Comments
Loading comments…
Newsletter
Get the weekly list of safe new skills, and the ones we pulled.