Skip to content
Back to skills

Pplm Controlled Generation Evaluation

ASecurity

Evaluate PPLM controlled-generation proxies with target-mass gain, KL fluency cost, and target consistency checks.

  • 247 stars
  • 0 votes
  • 0 copies
  • 2 views
  • Added September 9, 2026
testingpython

Security analysis

A100/100

Scanned September 9, 2026

npx -y skills add VectorSpaceLab/AREX-Skill --skill pplm_controlled_generation_evaluation --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Pplm Controlled Generation Evaluation?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Pplm Controlled Generation Evaluation
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/vectorspacelab-pplm-controlled-generation-evaluation/badge)](https://www.skillsdirectory.com/skills/vectorspacelab-pplm-controlled-generation-evaluation)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

SKILL.md
---
name: pplm_controlled_generation_evaluation
description: Evaluate PPLM controlled-generation proxies with target-mass gain, KL fluency cost, and target consistency checks.
---

# PPLM Controlled Generation Evaluation

Use this skill to decide whether a PPLM recovery run improved attribute control while preserving enough fluency. It is useful for full GPT-2 runs and for declared reduced/proxy experiments.

## Inputs
Base probabilities, controlled/fused probabilities, target token indices, and the module-plan recovery target.

## Outputs
Numeric metrics including target mass gain and KL divergence, plus pass/fail status against thresholds.

## Workflow
1. Sum target mass before and after control.
2. Compute absolute target-mass gain.
3. Compute KL from controlled/fused distribution to the base distribution.
4. Pass only when gain meets the target and KL is bounded.

## Validation
Run `python tests/test_controlled_generation_evaluation.py` or Distiller validation.

## Limitations
Human fluency and Perspective-style toxicity scores are outside this deterministic reduced evaluator.

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

Comments

Loading comments…