mistralai/mistral-inference
A minimal library for running Mistral language models including 7B, 8x7B, 8x22B, and specialized variants.

Velocity · 7d
+11
★ / day
Trend
→steady
star history
This is the official inference library from Mistral AI providing minimal code to run their language models. It supports various model sizes and variants including base models, code models like Codestral, math models like Mathstral, and vision models like Pixtral. The library handles model downloading and provides inference capabilities through Python APIs.