← all repositories

DreamLM/Dream

A 7B parameter diffusion language model that achieves performance comparable to autoregressive models of similar size.

1.2k stars Python Language ModelsML Frameworks
Dream
Velocity · 7d
+2.9
★ / day
Trend
steady
star history

Dream is a large diffusion language model (dLLM) with 7 billion parameters. Unlike traditional autoregressive LLMs, it generates text using a diffusion process. The project includes training code, evaluation code, and related variants for code generation (Dream-Coder) and infilling (DreamOn). It builds on the Huggingface transformers library and supports fine-tuning on custom datasets.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.