← all repositories
AIDC-AI/ComfyUI-Copilot

An AI intern for your ComfyUI node spaghetti

Alibaba's ComfyUI-Copilot turns natural language into Stable Diffusion workflows, then debugs the mess when it breaks.

ComfyUI-Copilot
Velocity · 7d
+11
★ / day
Trend
steady
star history

What it does ComfyUI-Copilot is a custom node that plugs an LLM agent into ComfyUI, the notoriously fiddly node-based interface for Stable Diffusion. You describe what you want—“a workflow for anime portraits with LoRA”—and it returns curated templates plus one AI-generated workflow. It can also debug broken node connections, rewrite existing workflows, tune parameters in batches, and recommend models or downstream nodes.

The interesting bit The v2.0 release reframes the tool as a “development coworker” rather than a helper: it reads your local ComfyUI environment to personalize suggestions, and its “GenLab” feature brute-forces parameter combinations with visual comparisons so you don’t have to. The ACL 2025 paper badge suggests this isn’t just weekend hackery.

Key highlights

  • Generates 3 library workflows + 1 AI workflow from text prompts, importable in one click
  • One-click debug: auto-detects parameter errors, connection mismatches, and missing models (with download prompts)
  • Workflow rewriting: adds nodes, adjusts parameters, optimizes logic based on follow-up complaints
  • GenLab tab: batch-runs parameter ranges and surfaces visual comparisons for tuning
  • Supports custom API keys and base URLs for OpenAI, LMStudio, or other providers
  • Node query system: deep-dive into selected nodes for docs, I/O specs, and usage tips

Caveats

  • The hosted API service is suspended; you must now bring your own API key and base URL
  • Node information query, job recommendations, and workflow generation are slated for removal from the official service
  • Workflow rewriting can hit context limits and interrupt; the README literally advises clicking “Clear Context” often
  • New models post-May 2025 (e.g., wan2.2) may confuse the LLM unless you manually add “expert experience”
  • Installation via ComfyUI Manager is described as “prone to bugs”; git clone is recommended

Verdict Worth a look if you generate images in ComfyUI regularly and are tired of hand-plumbing nodes. Skip it if you already have muscle memory for the node graph, or if “bring your own API key” sounds like too much friction for a convenience tool.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.