Tencent/TNN
Tencent's high-performance, cross-platform neural network inference framework for mobile, desktop, and server environments.

TNN is a uniform deep learning inference framework developed by Tencent Youtu Lab and Guangying Lab. It provides cross-platform deployment capabilities across mobile devices, desktop, and server environments with features including model compression, code pruning, and performance optimization. Based on ncnn and Rapidnet, it draws on industry best practices for high performance and extensibility while supporting hardware acceleration through various backends including TensorRT, OpenVINO, CoreML, and TensorFlow Lite.