Browser-native Gaussian splatting that runs your ML models per frame

What it does

Visionary is a web-native platform for real-time Gaussian Splatting — 3DGS, 4DGS, neural avatars, and custom variants — that runs entirely in the browser via WebGPU. It also handles traditional mesh formats (GLB, OBJ, FBX) and composites them with point clouds through depth-aware mixing. A built-in ONNX Runtime pipeline runs inference per frame, so your models can generate or update Gaussians dynamically, or apply post-processing like style transfer.

The interesting bit

The “Gaussian Generator” contract is the hook: export your trained model to ONNX, drop it in, and the renderer calls it every frame to produce fresh Gaussians. This turns the browser into a deployment target for research models, not just a passive viewer. The sorting of millions of Gaussian primitives happens on GPU, which the authors claim beats existing web viewers on identical assets — though no hard numbers are provided.

Key highlights

• Renders PLY, SPLAT, KSplat, SPZ, SOG, plus GLB/GLTF/FBX/OBJ, and ONNX-based dynamic formats in one interface
• Per-frame ONNX inference enables MLP-based 3DGS, 4DGS, avatars, and “any future algorithms” via standardized plug-in contract
• Hybrid depth compositing between meshes and Gaussian clouds without manual layering
• Ships as a three.js plugin with a TypeScript API; includes an online scene editor
• Apache 2.0, from Shanghai AI Lab and collaborators

Caveats

• Ubuntu is explicitly unsupported due to a Chrome WebGPU fp16 bug breaking ONNX pipelines
• macOS performance is poor except on high-end Apple Silicon (M4 Max or better); Windows with discrete GPU is strongly recommended
• “Superior rendering efficiency” versus other web viewers is claimed but not benchmarked in the README

Verdict

Researchers sitting on 3DGS/4DGS models they want to demo or deploy should look here — the ONNX bridge is genuinely useful. If you just need to view static Gaussian splats, lighter alternatives exist; if you’re on Linux or an older Mac, this is currently a non-starter.