**arXiv ID:** 1705.08142 **Authors:** Sebastian Ruder, Joachim Bingel, Isabelle Augenstein, Anders Søgaard **Published:** 2017-05-23T08:58:09Z **Abstract:** Multi-task learning (MTL) allows deep neural networks to learn from related tasks by sharing parameters with other networks. In practice, however, MTL involves searching an enormous space of possible parameter sharing architectures to find (a) the layers or subspaces that benefit from sharing, (b) the appropriate amount of sharing, and (c...
Installs into .claude/skills of the current project.
Sponsors
SSkills DirectorySkills Directory
Know which skills are safe — weekly.
SSkills DirectorySkills Directory
Is that skill safe to install?
Are you the author of Latent Multitask Architecture Learning?
Add the live security badge to your README. It updates with every re-scan.
[](https://www.skillsdirectory.com/skills/hiyenwong-latent-multitask-architecture-learning)
# Latent Multi-task Architecture Learning
**arXiv ID:** 1705.08142
**Authors:** Sebastian Ruder, Joachim Bingel, Isabelle Augenstein, Anders Søgaard
**Published:** 2017-05-23T08:58:09Z
**Abstract:**
Multi-task learning (MTL) allows deep neural networks to learn from related tasks by sharing parameters with other networks. In practice, however, MTL involves searching an enormous space of possible parameter sharing architectures to find (a) the layers or subspaces that benefit from sharing, (b) the appropriate amount of sharing, and (c) the appropriate relative weights of the different task losses. Recent work has addressed each of the above problems in isolation. In this work we present an approach that learns a latent multi-task architecture that jointly addresses (a)--(c). We present experiments on synthetic data and data from OntoNotes 5.0, including four different tasks and seven different domains. Our extension consistently outperforms previous approaches to learning latent architectures for multi-task problems and achieves up to 15% average error reductions over common approaches to MTL.
## Skill Description
This skill is generated from the arXiv paper: Latent Multi-task Architecture Learning (1705.08142).
## How to Use
[To be filled in by the user or by future automation]
## References
- [arXiv:1705.08142](http://arxiv.org/abs/1705.08142v3)
