Skip to content
Back to skills

Rnd Dual Return Ppo

ASecurity

Compute separate intrinsic and extrinsic discounted returns for RND-style PPO with dual value heads.

  • 247 stars
  • 0 votes
  • 0 copies
  • 4 views
  • Added September 9, 2026
testingpython

Security analysis

A100/100

Scanned September 9, 2026

npx -y skills add VectorSpaceLab/AREX-Skill --skill rnd_dual_return_ppo --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Rnd Dual Return Ppo?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Rnd Dual Return Ppo
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/vectorspacelab-rnd-dual-return-ppo/badge)](https://www.skillsdirectory.com/skills/vectorspacelab-rnd-dual-return-ppo)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

SKILL.md
---
name: rnd_dual_return_ppo
description: Compute separate intrinsic and extrinsic discounted returns for RND-style PPO with dual value heads.
---

# RND Dual Return PPO

Use this skill when combining RND intrinsic rewards with task extrinsic rewards under separate value heads. Do not collapse streams before return calculation when their discount factors or episode-boundary semantics differ.

## Inputs

- Extrinsic rewards, intrinsic rewards, and done flags.
- Extrinsic and intrinsic discount factors.
- Boolean flag indicating whether intrinsic returns are non-episodic.
- Optional extrinsic and intrinsic value estimates.

## Outputs

- Extrinsic discounted returns.
- Intrinsic discounted returns.
- Separate and combined advantages.

## Workflow

1. Compute extrinsic returns with episode termination resets.
2. Compute intrinsic returns with either episodic or non-episodic semantics.
3. Subtract stream-specific value estimates to get stream advantages.
4. Sum stream advantages for policy optimization while training value heads separately.

## Validation

Run `python tests/test_dual_returns.py` from this skill directory.

## Limitations

This skill implements the reward-stream contract, not a full PPO optimizer.

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

Comments

Loading comments…