Grsn Gated Recurrent Spiking Neurons For Pomdps And Marl

# GRSN: Gated Recurrent Spiking Neurons for POMDPs and MARL

**arXiv ID:** 2404.15597
**Authors:** Lang Qin, Ziming Wang, Runhao Jiang, Rui Yan, Huajin Tang
**Published:** 2024-04-24T02:20:50Z
**Abstract:**
Spiking neural networks (SNNs) are widely applied in various fields due to their energy-efficient and fast-inference capabilities. Applying SNNs to reinforcement learning (RL) can significantly reduce the computational resource requirements for agents and improve the algorithm's performance under resource-constrained conditions. However, in current spiking reinforcement learning (SRL) algorithms, the simulation results of multiple time steps can only correspond to a single-step decision in RL. This is quite different from the real temporal dynamics in the brain and also fails to fully exploit the capacity of SNNs to process temporal data. In order to address this temporal mismatch issue and further take advantage of the inherent temporal dynamics of spiking neurons, we propose a novel temporal alignment paradigm (TAP) that leverages the single-step update of spiking neurons to accumulate historical state information in RL and introduces gated units to enhance the memory capacity of spiking neurons. Experimental results show that our method can solve partially observable Markov decision processes (POMDPs) and multi-agent cooperation problems with similar performance as recurrent neural networks (RNNs) but with about 50% power consumption.

## Skill Description

This skill is generated from the arXiv paper: GRSN: Gated Recurrent Spiking Neurons for POMDPs and MARL (2404.15597).

## How to Use

[To be filled in by the user or by future automation]

## References

- [arXiv:2404.15597](http://arxiv.org/abs/2404.15597v1)