← all repositories

mistralai/mistral-inference

A minimal library for running Mistral language models including 7B, 8x7B, 8x22B, and specialized variants.

10.8k stars Jupyter Notebook Inference · ServingLanguage Models
mistral-inference
Velocity · 7d
+11
★ / day
Trend
steady
star history

This is the official inference library from Mistral AI providing minimal code to run their language models. It supports various model sizes and variants including base models, code models like Codestral, math models like Mathstral, and vision models like Pixtral. The library handles model downloading and provides inference capabilities through Python APIs.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.