Turning Stable Diffusion into a stop-motion studio
An extension that wrangles AUTOMATIC1111's webui into generating animated videos via math-driven keyframes.

What it does
Deforum plugs into the popular AUTOMATIC1111 Stable Diffusion webui and adds a dedicated tab for generating animations. You set keyframes with mathematical functions—think cos(t) driving prompt weights over time—then it renders frame sequences and spits out a video or GIF without leaving the browser.
The interesting bit
The project treats prompt engineering as a time-series problem. You can split positive and negative prompts with a --neg argument and modulate their influence with trigonometric functions, which is either elegant or mildly cursed depending on your feelings about JSON full of cosine waves.
Key highlights
- 3D animation mode with depth estimation (6.4 GB VRAM peak, 3.8 GB with
--lowvram) - Live frame preview during generation via a toolbar setting
- Math keyframing guide linked for the functionally inclined
- One-click video/GIF playback inside the GUI when done
- AGPL v3.0 licensed, with some third-party components under separate terms
Caveats
- Not fully backward-compatible with older Deforum notebooks or local versions; old settings may break or produce different results
- 3D mode has a “large delay at first” while depth models load
- Live preview mode explicitly warns it may slow generation
Verdict Worth a look if you’re already living in AUTOMATIC1111’s webui and want to graduate from still images to motion without learning a separate tool chain. Skip it if you need production-grade reliability or don’t enjoy debugging why your cosine-weighted strawberry prompt exploded on frame 47.