← all repositories
konlu/story-studio

An AI agent skill that ships a finished CapCut draft, not just a script

Story Studio compresses the entire short-video pipeline — topic, script, voiceover, images, timeline — into one skill your coding agent can drive end to end.

★1.1k stars Python Creative · DesignAgents
Too new to rank. Velocity needs a few days of history.
not enough history yet
star history

What it does

Story Studio is a Chinese-language content-creation skill pack for AI agents like Claude Code, Codex, or Cursor. You describe a video idea in natural language and the agent runs the whole production line: topic selection, script writing, voiceover synthesis, subtitle-timestamp alignment, per-shot image generation, and finally export of an editable CapCut (剪映) Pro draft file. It targets history-narrative and real-person-story verticals specifically, with two distilled “Writing-DNA” styles and a corpus of 370+ hit scripts baked in.

The interesting bit

The boring middle of the pipeline is where the engineering lives. Instead of guessing timings from word counts, it runs local speech recognition (Coli, built on sherpa-onnx) over the actual audio to produce word-level SRT timestamps, then plans image cuts around ~8-second narrative beats so the first frame matches the first sentence. It also anchors image generation with built-in reference images per style to keep the art direction from drifting across dozens of shots — a real failure mode of naive AI-image pipelines.

Key highlights

  • Two writing styles (historical-narrative, yuling-characterstory) with hook libraries, fact-checking rules, and strict word-count control (±5%)
  • Three visual styles — thick-paint historical comic, black-and-white documentary, historical realism — each with reference image sets and era/age-appropriate costuming details per shot
  • Dual voiceover paths: Doubao (Volcano Engine) TTS via streaming WebSocket, or drop in your own MP3 and the agent picks up from there
  • Generates a genuinely editable CapCut Pro draft via pyJianYingDraft, including slow push-pull keyframes and punch-zoom cuts across all shots
  • Modular: you can use just the script writer, just the hook polisher, or hand it existing assets and let it finish the timeline

Caveats

  • Licensed CC BY-NC-SA 4.0 — non-commercial use only, which limits adoption for monetized channels
  • The recommended TTS path requires a paid Volcano Engine API key (though it caches by text+voice hash to avoid duplicate billing)
  • Chinese-language content and Chinese-market tooling (CapCut, WeChat-video-style scripts) throughout; not a general-purpose video tool

Verdict

Worth a look if you produce Chinese history or biography short videos and already live in an agent-driven workflow — the CapCut-draft output and timestamp-accurate alignment are genuinely uncommon. Skip it if you need English content, commercial licensing, or a standalone app rather than an agent skill.

Frequently asked

What is konlu/story-studio?
Story Studio compresses the entire short-video pipeline — topic, script, voiceover, images, timeline — into one skill your coding agent can drive end to end.
Is story-studio open source?
Yes — konlu/story-studio is an open-source project tracked on heatdrop.
What language is story-studio written in?
konlu/story-studio is primarily written in Python.
How popular is story-studio?
konlu/story-studio has 1.1k stars on GitHub.
Where can I find story-studio?
konlu/story-studio is on GitHub at https://github.com/konlu/story-studio.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.