A fitting room that fits in a browser tab
A custom implementation of the VITON pipeline that overlays garments onto person images using pose estimation and segmentation, packaged as a self-contained Colab notebook with a Gradio UI.

What it does This project is a custom take on virtual try-on: you feed it a person photo and a garment, and it generates a composite image that drapes the new clothing onto the body. The pipeline leans on pose estimation, segmentation, and GAN-based generation to align fabric with anatomy. Everything is wired into a Gradio interface meant to run inside a Google Colab notebook.
The interesting bit
The author spent more time stripping dependencies than adding them. External services like remove.bg were swapped for the local rembg library, missing model weights were patched, and OpenPose setup was fixed so the entire pipeline runs without API keys or local GPU wrangling. It is essentially a repair job on a notoriously brittle CV stack.
Key highlights
- Rebuilds the VITON architecture as a Jupyter/Colab project
- Browser-based Gradio UI; no local installation required
- Removed external API dependencies in favor of local alternatives (e.g.,
rembgreplacingremove.bg) - Pipeline includes pose estimation, human segmentation, and GAN generation stages
- Author paused active development as of February 2024 but welcomes community issues and contributions
Caveats
- Citation section is marked “Work in progress”
- No future updates are planned from the original maintainer, though a comeback is teased
Verdict Good for students and CV hobbyists who want a runnable, API-free VITON demo to hack on. Production e-commerce teams should look elsewhere; this is a notebook-grade proof of concept with paused maintenance.
Frequently asked
- What is SwayamInSync/clothes-virtual-try-on?
- A custom implementation of the VITON pipeline that overlays garments onto person images using pose estimation and segmentation, packaged as a self-contained Colab notebook with a Gradio UI.
- Is clothes-virtual-try-on open source?
- Yes — SwayamInSync/clothes-virtual-try-on is an open-source project tracked on heatdrop.
- What language is clothes-virtual-try-on written in?
- SwayamInSync/clothes-virtual-try-on is primarily written in Jupyter Notebook.
- How popular is clothes-virtual-try-on?
- SwayamInSync/clothes-virtual-try-on has 540 stars on GitHub.
- Where can I find clothes-virtual-try-on?
- SwayamInSync/clothes-virtual-try-on is on GitHub at https://github.com/SwayamInSync/clothes-virtual-try-on.