← all repositories

Zhen-Dong/Magic-Me

A diffusion-based video generation system that creates custom videos featuring specific identities from provided photos using trained ID embeddings.

459 stars Python Image · Video · Audio
Magic-Me
Velocity · 7d
+0.5
★ / day
Trend
steady
star history

The project provides a framework called Magic-Me for generating personalized videos using a pre-trained ID token. It employs a customized video diffusion (VCD) approach with three key components: an ID module trained with cropped identity using prompt-to-segmentation to separate identity from background noise; a text-to-video module with 3D Gaussian noise prior for inter-frame consistency; and video-to-video modules for face deblurring and upscaling to higher resolution.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.