← all repositories

NVIDIA-AI-IOT/torch2trt

A Python converter that transforms PyTorch models into optimized TensorRT format for accelerated GPU inference.

torch2trt
Velocity · 7d
+1.9
★ / day
Trend
steady
star history

torch2trt provides a Python API to convert PyTorch modules to TensorRT engines, enabling significant inference speedups on NVIDIA hardware. Users wrap a PyTorch model and example input data, and the converter produces a TRTModule that executes the optimized TensorRT inference graph. The tool supports custom layer converters via decorators, facilitating extension to unsupported operations. It was originally developed for the JetBot project to accelerate computer vision inference on Jetson devices.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.