What it does This is a Python “skill” you install into AI coding agents (Cursor, Claude Code, Trae, etc.). You describe a video in plain Chinese — “make a 60-second movie recap” or “turn my vacation photos into a vlog with upbeat music” — and the agent builds the full CapCut timeline: imports assets, generates voiceover, syncs subtitles, drops in effects, and hits export. It also handles screen recording with auto-zoom highlights and can capture HTML/Canvas animations as video clips via Playwright.

The interesting bit The project doesn’t replace CapCut; it reverse-engineers the draft file format and automates the UI with simulated mouse/keyboard input. That means it can do things the official API can’t — like semantic footage matching where AI picks B-roll based on what the narration actually says — but it also means the tool is fragile by design.

Key highlights

• Natural-language control of full pipeline: script → voiceover → subtitles → music → export
• Web-to-Video: render HTML/JS/Canvas animations (Three.js, GSAP, etc.) and import as clips
• Smart Zoom for screen recordings: auto-tracks cursor, adds red-circle highlights, smooth camera follow
• Semantic footage matching: analyzes narration/subtitles to auto-select relevant B-roll from your library
• Multi-track timeline manipulation via direct draft-file editing (video, audio, stickers, effects, keyframes)

Caveats

• Auto-export only works on CapCut 5.9 or older; 6.0+ has too many popups that break the automation scripts
• Cannot trigger CapCut’s built-in AI features (smart cutout, beauty filters, auto-caption) — those need GPU processing the tool can’t access
• Desktop-only; mobile CapCut not supported
• You must restart CapCut to see newly generated drafts (file list doesn’t auto-refresh)

Verdict Worth a look if you’re already using AI agents for code and want to automate repetitive video editing without learning CapCut’s internals. Skip it if you need the latest CapCut features or want something stable enough for client work — this is duct-tape automation, not a product.