Arxiv 2509 25035 Ultra Fast Language Generation Via Discrete Diffusion Diverg
ASecurity
We introduce DiDi-Instruct, a training-based method that initializes from a pre-trained diffusion LLM and distills a few-step student for fast generation. The model matches or surpasses its dLLM teacher and GPT-2 baseline while providing up to 64x acceleration. Based on integral KL-divergence minimization with grouped reward normalization and reward-guided ancestral sampler. Achieves perplexity 62.2 (8 NFEs) to 18.4 (128 NFEs) on OpenWebText.
Installs into .claude/skills of the current project.
Are you the author of Arxiv 2509 25035 Ultra Fast Language Generation Via Discrete Diffusion Diverg?
Add the live security badge to your README. It updates with every re-scan.
[](https://www.skillsdirectory.com/skills/hiyenwong-arxiv-2509-25035-ultra-fast-language-generation-vi)
---
title: "Ultra-Fast Language Generation via Discrete Diffusion Divergence Instruct"
authors: "Haoyang Zheng, Xinyang Liu, Cindy Xiangrui Kong, Nan Jiang, Zheyuan Hu, Weijian Luo, Wei Deng, Guang Lin"
arxiv_id: "2509.25035"
categories: "cs.CL; cs.AI; cs.LG"
utility: 0.9
date_added: "2026-09-29"
category: "nlp-llm"
---
# Ultra-Fast Language Generation via Discrete Diffusion Divergence Instruct
## Abstract
We introduce DiDi-Instruct, a training-based method that initializes from a pre-trained diffusion LLM and distills a few-step student for fast generation. The model matches or surpasses its dLLM teacher and GPT-2 baseline while providing up to 64x acceleration. Based on integral KL-divergence minimization with grouped reward normalization and reward-guided ancestral sampler. Achieves perplexity 62.2 (8 NFEs) to 18.4 (128 NFEs) on OpenWebText.
## Key Contributions
- Novel approach in nlp llm domain
- Utility score: 0.9
- Published on arXiv: 2509.25035
## Potential Applications
- Research reference for nlp llm
- Building block for related systems
