Skip to content
Back to skills

Sparse Meta Networks For Sequential Adaptation And Its Application To Adaptive Language Modelling

ASecurity

**arXiv ID:** 2009.01803 **Authors:** Tsendsuren Munkhdalai **Published:** 2020-09-03T17:06:52Z **Abstract:** Training a deep neural network requires a large amount of single-task data and involves a long time-consuming optimization phase. This is not scalable to complex, realistic environments with new unexpected changes. Humans can perform fast incremental learning on the fly and memory systems in the brain play a critical role. We introduce Sparse Meta Networks -- a meta-learning approach ...

  • 3 stars
  • 0 votes
  • 0 copies
  • 3 views
  • Added September 11, 2026
toolsgoperformance

Security analysis

A100/100

Scanned September 11, 2026

npx -y skills add hiyenwong/ai_collection --skill sparse-meta-networks-for-sequential-adaptation-and-its-application-to-adaptive-language-modelling --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Sparse Meta Networks For Sequential Adaptation And Its Application To Adaptive Language Modelling?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Sparse Meta Networks For Sequential Adaptation And Its Application To Adaptive Language Modelling
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/hiyenwong-sparse-meta-networks-for-sequential-adaptation-and/badge)](https://www.skillsdirectory.com/skills/hiyenwong-sparse-meta-networks-for-sequential-adaptation-and)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

Download with Pro
SKILL.md
# Sparse Meta Networks for Sequential Adaptation and its Application to Adaptive Language Modelling

**arXiv ID:** 2009.01803
**Authors:** Tsendsuren Munkhdalai
**Published:** 2020-09-03T17:06:52Z
**Abstract:**
Training a deep neural network requires a large amount of single-task data and involves a long time-consuming optimization phase. This is not scalable to complex, realistic environments with new unexpected changes. Humans can perform fast incremental learning on the fly and memory systems in the brain play a critical role. We introduce Sparse Meta Networks -- a meta-learning approach to learn online sequential adaptation algorithms for deep neural networks, by using deep neural networks. We augment a deep neural network with a layer-specific fast-weight memory. The fast-weights are generated sparsely at each time step and accumulated incrementally through time providing a useful inductive bias for online continual adaptation. We demonstrate strong performance on a variety of sequential adaptation scenarios, from a simple online reinforcement learning to a large scale adaptive language modelling.

## Skill Description

This skill is generated from the arXiv paper: Sparse Meta Networks for Sequential Adaptation and its Application to Adaptive Language Modelling (2009.01803).

## How to Use

[To be filled in by the user or by future automation]

## References

- [arXiv:2009.01803](http://arxiv.org/abs/2009.01803v1)

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

View all in tools →

Comments

Loading comments…

Newsletter

Get the weekly list of safe new skills, and the ones we pulled.