Video Game Level Design As A Multiagent Reinforcement Learning Problem

# Video Game Level Design as a Multi-Agent Reinforcement Learning Problem

**arXiv ID:** 2510.04862
**Authors:** Sam Earle, Zehua Jiang, Eugene Vinitsky, Julian Togelius
**Published:** 2025-10-06T14:49:21Z
**Abstract:**
Procedural Content Generation via Reinforcement Learning (PCGRL) offers a method for training controllable level designer agents without the need for human datasets, using metrics that serve as proxies for level quality as rewards. Existing PCGRL research focuses on single generator agents, but are bottlenecked by the need to frequently recalculate heuristics of level quality and the agent's need to navigate around potentially large maps. By framing level generation as a multi-agent problem, we mitigate the efficiency bottleneck of single-agent PCGRL by reducing the number of reward calculations relative to the number of agent actions. We also find that multi-agent level generators are better able to generalize to out-of-distribution map shapes, which we argue is due to the generators' learning more local, modular design policies. We conclude that treating content generation as a distributed, multi-agent task is beneficial for generating functional artifacts at scale.

## Skill Description

This skill is generated from the arXiv paper: Video Game Level Design as a Multi-Agent Reinforcement Learning Problem (2510.04862).

## How to Use

[To be filled in by the user or by future automation]

## References

- [arXiv:2510.04862](http://arxiv.org/abs/2510.04862v1)