Skip to content
Back to skills

Efficient Exploration Using Modelbased Qualitydiversity With Gradients

ASecurity

**arXiv ID:** 2211.12610 **Authors:** Bryan Lim, Manon Flageat, Antoine Cully **Published:** 2022-11-22T22:19:01Z **Abstract:** Exploration is a key challenge in Reinforcement Learning, especially in long-horizon, deceptive and sparse-reward environments. For such applications, population-based approaches have proven effective. Methods such as Quality-Diversity deals with this by encouraging novel solutions and producing a diversity of behaviours. However, these methods are driven by either u...

  • 3 stars
  • 0 votes
  • 0 copies
  • 2 views
  • Added September 11, 2026
toolsgoperformance

Security analysis

A100/100

Scanned September 11, 2026

npx -y skills add hiyenwong/ai_collection --skill efficient-exploration-using-modelbased-qualitydiversity-with-gradients --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Efficient Exploration Using Modelbased Qualitydiversity With Gradients?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Efficient Exploration Using Modelbased Qualitydiversity With Gradients
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/hiyenwong-efficient-exploration-using-modelbased-qualitydive/badge)](https://www.skillsdirectory.com/skills/hiyenwong-efficient-exploration-using-modelbased-qualitydive)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

Download with Pro
SKILL.md
# Efficient Exploration using Model-Based Quality-Diversity with Gradients

**arXiv ID:** 2211.12610
**Authors:** Bryan Lim, Manon Flageat, Antoine Cully
**Published:** 2022-11-22T22:19:01Z
**Abstract:**
Exploration is a key challenge in Reinforcement Learning, especially in long-horizon, deceptive and sparse-reward environments. For such applications, population-based approaches have proven effective. Methods such as Quality-Diversity deals with this by encouraging novel solutions and producing a diversity of behaviours. However, these methods are driven by either undirected sampling (i.e. mutations) or use approximated gradients (i.e. Evolution Strategies) in the parameter space, which makes them highly sample-inefficient. In this paper, we propose a model-based Quality-Diversity approach. It extends existing QD methods to use gradients for efficient exploitation and leverage perturbations in imagination for efficient exploration. Our approach optimizes all members of a population simultaneously to maintain both performance and diversity efficiently by leveraging the effectiveness of QD algorithms as good data generators to train deep models. We demonstrate that it maintains the divergent search capabilities of population-based approaches on tasks with deceptive rewards while significantly improving their sample efficiency and quality of solutions.

## Skill Description

This skill is generated from the arXiv paper: Efficient Exploration using Model-Based Quality-Diversity with Gradients (2211.12610).

## How to Use

[To be filled in by the user or by future automation]

## References

- [arXiv:2211.12610](http://arxiv.org/abs/2211.12610v1)

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

View all in tools →

Comments

Loading comments…

Newsletter

Get the weekly list of safe new skills, and the ones we pulled.