Neural Architecture Search With Mixed Bioinspired Learning Rules

# Neural Architecture Search with Mixed Bio-inspired Learning Rules

**arXiv ID:** 2507.13485
**Authors:** Imane Hamzaoui, Riyadh Baghdadi
**Published:** 2025-07-17T18:49:38Z
**Abstract:**
Bio-inspired neural networks are attractive for their adversarial robustness, energy frugality, and closer alignment with cortical physiology, yet they often lag behind back-propagation (BP) based models in accuracy and ability to scale. We show that allowing the use of different bio-inspired learning rules in different layers, discovered automatically by a tailored neural-architecture-search (NAS) procedure, bridges this gap. Starting from standard NAS baselines, we enlarge the search space to include bio-inspired learning rules and use NAS to find the best architecture and learning rule to use in each layer. We show that neural networks that use different bio-inspired learning rules for different layers have better accuracy than those that use a single rule across all the layers. The resulting NN that uses a mix of bio-inspired learning rules sets new records for bio-inspired models: 95.16% on CIFAR-10, 76.48% on CIFAR-100, 43.42% on ImageNet16-120, and 60.51% top-1 on ImageNet. In some regimes, they even surpass comparable BP-based networks while retaining their robustness advantages. Our results suggest that layer-wise diversity in learning rules allows better scalability and accuracy, and motivates further research on mixing multiple bio-inspired learning rules in the same network.

## Skill Description

This skill is generated from the arXiv paper: Neural Architecture Search with Mixed Bio-inspired Learning Rules (2507.13485).

## How to Use

[To be filled in by the user or by future automation]

## References

- [arXiv:2507.13485](http://arxiv.org/abs/2507.13485v1)