Skip to content
Back to skills

Playing The Lottery With Rewards And Multiple Languages Lottery Tickets In Rl And Nlp

ASecurity

**arXiv ID:** 1906.02768 **Authors:** Haonan Yu, Sergey Edunov, Yuandong Tian, Ari S. Morcos **Published:** 2019-06-06T18:38:38Z **Abstract:** The lottery ticket hypothesis proposes that over-parameterization of deep neural networks (DNNs) aids training by increasing the probability of a "lucky" sub-network initialization being present rather than by helping the optimization process (Frankle & Carbin, 2019). Intriguingly, this phenomenon suggests that initialization strategies for DNNs can be...

  • 3 stars
  • 0 votes
  • 0 copies
  • 4 views
  • Added September 11, 2026
toolsperformance

Security analysis

A100/100

Scanned September 11, 2026

npx -y skills add hiyenwong/ai_collection --skill playing-the-lottery-with-rewards-and-multiple-languages-lottery-tickets-in-rl-and-nlp --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Playing The Lottery With Rewards And Multiple Languages Lottery Tickets In Rl And Nlp?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Playing The Lottery With Rewards And Multiple Languages Lottery Tickets In Rl And Nlp
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/hiyenwong-playing-the-lottery-with-rewards-and-multiple-lang/badge)](https://www.skillsdirectory.com/skills/hiyenwong-playing-the-lottery-with-rewards-and-multiple-lang)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

Download with Pro
SKILL.md
# Playing the lottery with rewards and multiple languages: lottery tickets in RL and NLP

**arXiv ID:** 1906.02768
**Authors:** Haonan Yu, Sergey Edunov, Yuandong Tian, Ari S. Morcos
**Published:** 2019-06-06T18:38:38Z
**Abstract:**
The lottery ticket hypothesis proposes that over-parameterization of deep neural networks (DNNs) aids training by increasing the probability of a "lucky" sub-network initialization being present rather than by helping the optimization process (Frankle & Carbin, 2019). Intriguingly, this phenomenon suggests that initialization strategies for DNNs can be improved substantially, but the lottery ticket hypothesis has only previously been tested in the context of supervised learning for natural image tasks. Here, we evaluate whether "winning ticket" initializations exist in two different domains: natural language processing (NLP) and reinforcement learning (RL).For NLP, we examined both recurrent LSTM models and large-scale Transformer models (Vaswani et al., 2017). For RL, we analyzed a number of discrete-action space tasks, including both classic control and pixel control. Consistent with workin supervised image classification, we confirm that winning ticket initializations generally outperform parameter-matched random initializations, even at extreme pruning rates for both NLP and RL. Notably, we are able to find winning ticket initializations for Transformers which enable models one-third the size to achieve nearly equivalent performance. Together, these results suggest that the lottery ticket hypothesis is not restricted to supervised learning of natural images, but rather represents a broader phenomenon in DNNs.

## Skill Description

This skill is generated from the arXiv paper: Playing the lottery with rewards and multiple languages: lottery tickets in RL and NLP (1906.02768).

## How to Use

[To be filled in by the user or by future automation]

## References

- [arXiv:1906.02768](http://arxiv.org/abs/1906.02768v3)

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

View all in tools →

Comments

Loading comments…

Newsletter

Get the weekly list of safe new skills, and the ones we pulled.