Skip to content
Back to skills

Reward Projection

ASecurity

Project late-specified rewards into backward representation coordinates for immediate FB policy adaptation.

  • 247 stars
  • 0 votes
  • 0 copies
  • 1 view
  • Added September 9, 2026
ai-agentspythongo

Security analysis

A100/100

Scanned September 9, 2026

npx -y skills add VectorSpaceLab/AREX-Skill --skill reward_projection --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Reward Projection?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Reward Projection
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/vectorspacelab-reward-projection/badge)](https://www.skillsdirectory.com/skills/vectorspacelab-reward-projection)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

SKILL.md
---
name: reward_projection
description: Project late-specified rewards into backward representation coordinates for immediate FB policy adaptation.
---

# Reward Projection

Use this skill after an FB backward embedding has been learned and a reward is specified later. It should not update the reward-free embeddings or run new task-specific RL.

## Inputs

- Backward embeddings `B` indexed by state or goal.
- Reward observations as `{index, reward}` records or a sparse goal index.

## Outputs

- Task vector `z_R` as the weighted sum or average of backward embeddings.
- Provenance describing which reward entries contributed.

## Workflow

1. Validate that all reward indices exist in `B`.
2. Compute `z_R = sum_g B(g) r(g)` for explicit finite rewards.
3. Preserve multi-goal rewards by summing their weighted backward vectors.
4. Return diagnostics and never mutate `F` or `B`.

## Validation

Run `python scripts/project_reward.py --self-test`. The test checks sparse and composite rewards.

## Limitations

For continuous goals this reduced script expects sampled reward observations rather than integrals over an unknown density.

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

Comments

Loading comments…

Newsletter

Get the weekly list of safe new skills, and the ones we pulled.