openvinotoolkit/openvino
OpenVINO is an Intel-sponsored open-source toolkit for optimizing and deploying deep learning inference across CPUs, GPUs, and accelerators.

OpenVINO provides inference optimization and deployment capabilities for deep learning models, supporting frameworks like PyTorch, TensorFlow, ONNX, and Hugging Face transformers/diffusers. It targets Intel hardware across CPUs, integrated GPUs, and dedicated accelerators, with built-in optimization passes for quantization, pruning, and compilation. The toolkit also maintains a separate generative AI library for LLM inference and diffusion model support.