← all repositories

sonos/tract

A Rust-based neural-network inference engine that loads, optimizes, and runs ONNX and NNEF models on CPUs, GPUs, and WebAssembly.

tract
Velocity · 7d
+0.9
★ / day
Trend
steady
star history

Tract is a lightweight, self-contained inference runtime written in Rust that supports ONNX and NNEF model formats. It optimizes and compiles neural-network models for various backends including embedded ARM CPUs, NVIDIA/Apple GPUs, and browser WebAssembly. The project is used in production at Sonos for wake-word detection and streaming speech-recognition, and supports running LLMs, text-to-image, and computer-vision models.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.