A lyric MV where every frame is a function of song time

What it does

This is the render engine for an unofficial lyric video of Mili’s “world.execute(me);”. The film is staged as a chat: “I” is a personified Claude in orange, “you” is an unseen user who exists only as a cursor, typing, and messages. Nothing is edited footage — every frame is drawn in the browser (Canvas 2D + WebGL2) from the song timestamp alone, then piped frame by frame through headless Chrome into ffmpeg. Version 4 is complete, with 1080p60 and 4K60 exports done.

The interesting bit

The code was written by Claude via Claude Code, and the maker has published the entire paper trail: the full v4 prompt (~23,000 Chinese characters), the fix-round prompt, and a progress log noting where the AI didn’t do as asked. It’s a rare, honest record of a human-directs-AI creative workflow — explicitly a log, not a one-click recipe (the v4 prompt assumes v3 already exists).

Key highlights

• Three visual modes: a code-drawn chat interface, full-screen “plate” prints in three flat inks, and a pure code/terminal section for EXECUTION.
• Bring-your-own song and lyrics: the repo ships neither. A tool matches your LRC’s words against the film’s fixed timing table, ignoring your file’s timestamps so cues never drift.
• The lyric matcher re-splits merged lines, skips credits/translation rows, and refuses to render if lines are missing.
• The photosensitivity warning range in the README is computed from config.json and stamped in automatically.
• Licensing is carefully layered: code MIT, character silhouettes CC BY-NC-SA, song governed by Mili’s official guidelines.

Caveats

• Built and tested only on Windows 11; other platforms are untried.
• Prompts are in Chinese (the docs index explains in English what each file contains).
• Exports contain the original song, so publishing is personal/non-commercial only, with AI-content disclosure.

Verdict

Worth a look for anyone interested in AI-assisted creative coding or deterministic, time-driven rendering — the prompt archive alone is a useful artifact. If you wanted a ready-to-watch video or a reusable MV template without licensing homework, this isn’t it.