← all repositories
AILab-CVC/VideoCrafter

An open video generator that admits its I2V sibling is better

Open-source text-to-video and image-to-video diffusion models that claim to overcome data scarcity by building on Stable Diffusion.

5.1k stars Python Image · Video · Audio
VideoCrafter
Not currently ranked — collecting fresh signals.
star history

What it does VideoCrafter is an open-source video generation and editing toolbox built on top of Stable Diffusion. It ships with pretrained diffusion models for both text-to-video and image-to-video synthesis. The VideoCrafter2 release targets improved motion quality and concept combination despite being trained on limited data.

The interesting bit The authors are refreshingly candid: for high-resolution image-to-video work, they openly steer users toward their own dedicated successor, DynamiCrafter. VideoCrafter2’s pitch is squeezing better quality from less data, though the README leaves the technical details to the linked paper.

Key highlights

  • Dual-mode generation: text-to-video and image-to-video in one repo
  • VideoCrafter2 claims better motion and concept combination than its predecessor with limited data
  • Built on Stable Diffusion; pretrained checkpoints hosted on Hugging Face
  • Includes a local Gradio demo for interactive generation
  • Explicitly restricted to personal, research, and non-commercial use

Caveats

  • For high-resolution image-to-video, the authors recommend DynamiCrafter instead
  • VideoCrafter2’s text-to-video output is 320×512, which is modest by current standards
  • The codebase is research-only and carries a non-commercial disclaimer

Verdict A sensible starting point for researchers and hobbyists who want an open, Stable-Diffusion-based video diffusion playground. Commercial teams and anyone needing polished high-res output should probably follow the authors’ own advice and look at DynamiCrafter.

Frequently asked

What is AILab-CVC/VideoCrafter?
Open-source text-to-video and image-to-video diffusion models that claim to overcome data scarcity by building on Stable Diffusion.
Is VideoCrafter open source?
Yes — AILab-CVC/VideoCrafter is an open-source project tracked on heatdrop.
What language is VideoCrafter written in?
AILab-CVC/VideoCrafter is primarily written in Python.
How popular is VideoCrafter?
AILab-CVC/VideoCrafter has 5.1k stars on GitHub.
Where can I find VideoCrafter?
AILab-CVC/VideoCrafter is on GitHub at https://github.com/AILab-CVC/VideoCrafter.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.