← all repositories

XiangLi1999/Diffusion-LM

Diffusion-LM is a diffusion-model-based approach to controllable text generation that learns to denoise sequences of embeddings to produce text conditioned on classifier-guided constraints.

1.2k stars Python Language Models
Diffusion-LM
Velocity · 7d
+0.8
★ / day
Trend
steady
star history

This repository implements a diffusion model architecture for text generation, replacing autoregressive decoding with an iterative denoising process over continuous text embeddings. The model trains on paired datasets (E2E, ROCstory) using a transformer backbone and supports controllable generation by training a classifier (e.g., syntactic parser) to guide the diffusion sampling process toward desired attributes.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.