microsoft/Llama-2-Onnx
Microsoft provides optimized ONNX-format versions of Meta's Llama 2 language models for efficient cross-platform inference.
Not currently ranked — collecting fresh signals.
star history
This repository hosts ONNX (Open Neural Network Exchange) optimized versions of Meta’s Llama 2 language models. It provides multiple variants across different model sizes (7B, 13B) and precision formats (float16, float32, fine-tuned). The ONNX format enables efficient cross-platform inference serving with hardware acceleration.
Frequently asked
- What is microsoft/Llama-2-Onnx?
- Microsoft provides optimized ONNX-format versions of Meta's Llama 2 language models for efficient cross-platform inference.
- Is Llama-2-Onnx open source?
- Yes — microsoft/Llama-2-Onnx is an open-source project tracked on heatdrop.
- What language is Llama-2-Onnx written in?
- microsoft/Llama-2-Onnx is primarily written in Python.
- How popular is Llama-2-Onnx?
- microsoft/Llama-2-Onnx has 1k stars on GitHub.
- Where can I find Llama-2-Onnx?
- microsoft/Llama-2-Onnx is on GitHub at https://github.com/microsoft/Llama-2-Onnx.