Lifetime Policy Reuse And The Importance Of Task Capacity
ASecurity
**arXiv ID:** 2106.01741 **Authors:** David M. Bossens, Adam J. Sobey **Published:** 2021-06-03T10:42:49Z **Abstract:** A long-standing challenge in artificial intelligence is lifelong reinforcement learning, where learners are given many tasks in sequence and must transfer knowledge between tasks while avoiding catastrophic forgetting. Policy reuse and other multi-policy reinforcement learning techniques can learn multiple tasks but may generate many policies. This paper presents two novel c...
Installs into .claude/skills of the current project.
Sponsors
SSkills DirectorySkills Directory
Know which skills are safe — weekly.
SSkills DirectorySkills Directory
Is that skill safe to install?
Are you the author of Lifetime Policy Reuse And The Importance Of Task Capacity?
Add the live security badge to your README. It updates with every re-scan.
[](https://www.skillsdirectory.com/skills/hiyenwong-lifetime-policy-reuse-and-the-importance-of-task-c)
# Lifetime policy reuse and the importance of task capacity
**arXiv ID:** 2106.01741
**Authors:** David M. Bossens, Adam J. Sobey
**Published:** 2021-06-03T10:42:49Z
**Abstract:**
A long-standing challenge in artificial intelligence is lifelong reinforcement learning, where learners are given many tasks in sequence and must transfer knowledge between tasks while avoiding catastrophic forgetting. Policy reuse and other multi-policy reinforcement learning techniques can learn multiple tasks but may generate many policies. This paper presents two novel contributions, namely 1) Lifetime Policy Reuse, a model-agnostic policy reuse algorithm that avoids generating many policies by optimising a fixed number of near-optimal policies through a combination of policy optimisation and adaptive policy selection; and 2) the task capacity, a measure for the maximal number of tasks that a policy can accurately solve. Comparing two state-of-the-art base-learners, the results demonstrate the importance of Lifetime Policy Reuse and task capacity based pre-selection on an 18-task partially observable Pacman domain and a Cartpole domain of up to 125 tasks.
## Skill Description
This skill is generated from the arXiv paper: Lifetime policy reuse and the importance of task capacity (2106.01741).
## How to Use
[To be filled in by the user or by future automation]
## References
- [arXiv:2106.01741](http://arxiv.org/abs/2106.01741v3)