**arXiv ID:** 2011.10568 **Authors:** Azhar Shaikh, Nishant Sinha **Published:** 2020-11-21T09:40:26Z **Abstract:** Task-incremental learning involves the challenging problem of learning new tasks continually, without forgetting past knowledge. Many approaches address the problem by expanding the structure of a shared neural network as tasks arrive, but struggle to grow optimally, without losing past knowledge. We present a new framework, Learn to Bind and Grow, which learns a neural architec...
Installs into .claude/skills of the current project.
Sponsors
SSkills DirectorySkills Directory
Know which skills are safe — weekly.
SSkills DirectorySkills Directory
Is that skill safe to install?
Are you the author of Learn To Bind And Grow Neural Structures?
Add the live security badge to your README. It updates with every re-scan.
[](https://www.skillsdirectory.com/skills/hiyenwong-learn-to-bind-and-grow-neural-structures)
# Learn to Bind and Grow Neural Structures
**arXiv ID:** 2011.10568
**Authors:** Azhar Shaikh, Nishant Sinha
**Published:** 2020-11-21T09:40:26Z
**Abstract:**
Task-incremental learning involves the challenging problem of learning new tasks continually, without forgetting past knowledge. Many approaches address the problem by expanding the structure of a shared neural network as tasks arrive, but struggle to grow optimally, without losing past knowledge. We present a new framework, Learn to Bind and Grow, which learns a neural architecture for a new task incrementally, either by binding with layers of a similar task or by expanding layers which are more likely to conflict between tasks. Central to our approach is a novel, interpretable, parameterization of the shared, multi-task architecture space, which then enables computing globally optimal architectures using Bayesian optimization. Experiments on continual learning benchmarks show that our framework performs comparably with earlier expansion based approaches and is able to flexibly compute multiple optimal solutions with performance-size trade-offs.
## Skill Description
This skill is generated from the arXiv paper: Learn to Bind and Grow Neural Structures (2011.10568).
## How to Use
[To be filled in by the user or by future automation]
## References
- [arXiv:2011.10568](http://arxiv.org/abs/2011.10568v1)
