Chat-based video editing by committee of AI agents

What it does

Director is a framework for building video agents that handle tasks like search, editing, compilation, and generation through a chat interface. You type a command—say, asking it to find highlights and share them—and a reasoning engine delegates the work across specialized agents, then streams the result. It sits on top of VideoDB’s infrastructure and ships with over 20 pre-built agents for summarizing, clipping, dubbing, subtitling, and even generating full movies from scripts.

The interesting bit

The core is a reasoning engine that acts less like a simple router and more like a project manager: it maintains context, breaks tasks into steps, and coordinates multiple agents in real time. That means a single sentence can trigger a chain of uploads, scene detection, editing, and third-party integrations without manual scripting.

Key highlights

• Ships with 20+ pre-built agents for common video operations like search, summarization, and translation.
• Modular architecture with a backend reasoning engine, chat UI, video player, and collection view as separate components.
• Extensible: new agents are created by copying a template and registering a Python class.
• Integrates with external LLMs and GenAI APIs while handling cloud storage, indexing, and streaming through VideoDB.
• Can run locally or self-hosted on cloud platforms.

Caveats

• Adding a new agent still requires manually importing it and appending it to a list in handler.py—functional, but not quite plug-and-play.

Verdict

Developers building media pipelines or video-centric SaaS tools should look here; if you just need a one-off ffmpeg script, this is overkill.