Skip to content
Back to skills

Towards Mental Time Travel A Hierarchical Memory For Reinforcement Learning Agents

ASecurity

**arXiv ID:** 2105.14039 **Authors:** Andrew Kyle Lampinen, Stephanie C. Y. Chan, Andrea Banino, Felix Hill **Published:** 2021-05-28T18:12:28Z **Abstract:** Reinforcement learning agents often forget details of the past, especially after delays or distractor tasks. Agents with common memory architectures struggle to recall and integrate across multiple timesteps of a past event, or even to recall the details of a single timestep that is followed by distractor tasks. To address these limitati...

  • 3 stars
  • 0 votes
  • 0 copies
  • 3 views
  • Added September 11, 2026
toolsapi

Works with

  • api

Security analysis

A100/100

Scanned September 11, 2026

npx -y skills add hiyenwong/ai_collection --skill towards-mental-time-travel-a-hierarchical-memory-for-reinforcement-learning-agents --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Towards Mental Time Travel A Hierarchical Memory For Reinforcement Learning Agents?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Towards Mental Time Travel A Hierarchical Memory For Reinforcement Learning Agents
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/hiyenwong-towards-mental-time-travel-a-hierarchical-memory-f/badge)](https://www.skillsdirectory.com/skills/hiyenwong-towards-mental-time-travel-a-hierarchical-memory-f)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

Download with Pro
SKILL.md
# Towards mental time travel: a hierarchical memory for reinforcement learning agents

**arXiv ID:** 2105.14039
**Authors:** Andrew Kyle Lampinen, Stephanie C. Y. Chan, Andrea Banino, Felix Hill
**Published:** 2021-05-28T18:12:28Z
**Abstract:**
Reinforcement learning agents often forget details of the past, especially after delays or distractor tasks. Agents with common memory architectures struggle to recall and integrate across multiple timesteps of a past event, or even to recall the details of a single timestep that is followed by distractor tasks. To address these limitations, we propose a Hierarchical Chunk Attention Memory (HCAM), which helps agents to remember the past in detail. HCAM stores memories by dividing the past into chunks, and recalls by first performing high-level attention over coarse summaries of the chunks, and then performing detailed attention within only the most relevant chunks. An agent with HCAM can therefore "mentally time-travel" -- remember past events in detail without attending to all intervening events. We show that agents with HCAM substantially outperform agents with other memory architectures at tasks requiring long-term recall, retention, or reasoning over memory. These include recalling where an object is hidden in a 3D environment, rapidly learning to navigate efficiently in a new neighborhood, and rapidly learning and retaining new object names. Agents with HCAM can extrapolate to task sequences much longer than they were trained on, and can even generalize zero-shot from a meta-learning setting to maintaining knowledge across episodes. HCAM improves agent sample efficiency, generalization, and generality (by solving tasks that previously required specialized architectures). Our work is a step towards agents that can learn, interact, and adapt in complex and temporally-extended environments.

## Skill Description

This skill is generated from the arXiv paper: Towards mental time travel: a hierarchical memory for reinforcement learning agents (2105.14039).

## How to Use

[To be filled in by the user or by future automation]

## References

- [arXiv:2105.14039](http://arxiv.org/abs/2105.14039v3)

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

View all in tools →

Comments

Loading comments…

Newsletter

Get the weekly list of safe new skills, and the ones we pulled.