← all repositories
tin2tin/Pallaidium

Blender's VSE becomes a generative AI film studio

A free add-on that turns Blender's Video Sequence Editor into an end-to-end AI movie pipeline, from script to screen and back again.

Pallaidium
Velocity · 7d
+1.2
★ / day
Trend
steady
star history

What it does

Pallaidium is a Blender add-on that parks a full generative AI studio inside the Video Sequence Editor. You can write or import a scene description, convert it to a screenplay with shots, generate images and video, add AI voices and music, edit by emotional weight, then reverse the process—extract captions, reconstruct the screenplay, and refine. All output lands directly on the VSE timeline as strips.

The interesting bit

The “round-trip” workflow is the unusual part: it treats AI generation as pre-visualization, not final product. You prototype the entire film, decide what actually works, then go shoot the real thing with the confidence of someone who has already made it once. The README calls this “you only truly understand how your film should have been made once it is finished”—and builds the tool around that insight.

Key highlights

  • Supports text/image/video inputs mapped to image, video, text, audio, music, and speech outputs (full matrix in README)
  • Auto-discovered model plugins: drop a single .py file into models_plugins/ to register new HuggingFace models
  • Async Render Queue with per-job status tracking (PENDING / RUNNING / COMPLETED / FAILED) and start/stop/cancel controls
  • Recent additions: Qwen3 TTS voice cloning, ACE Step audio/music generation, Whisper-based subtitle extraction, LTX-2 video with custom LoRA support
  • One-click dependency install (though Windows admin rights and 6+ GB VRAM are required)

Caveats

  • Windows-first; Linux support is explicitly “limited” and relies on contributor patches
  • Requires Blender 5.2+, CUDA 12.4, and an Nvidia card with 6 GB VRAM minimum; some models need 24 GB
  • First model run downloads 5–10 GB; each model is 6+ GB. Storage adds up fast
  • Uninstall is blunt: delete the entire Blender folder, or manually purge HuggingFace cache

Verdict

Film students, indie pre-viz artists, and Blender-native creators who want to iterate on entire scenes without leaving their editor should grab this. If you are on Linux, lack VRAM, or need production-grade reliability over rapid prototyping, look elsewhere for now.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.