kubeai-project/kubeai
A Kubernetes operator that deploys and scales ML inference servers including vLLM, Ollama, FasterWhisper, and embedding models.
Not currently ranked — collecting fresh signals.
star history
KubeAI is an AI inference operator for Kubernetes that simplifies serving machine learning models in production. It supports large language models via vLLM and Ollama, speech-to-text via FasterWhisper, vector embeddings via Infinity, and reranking with cross-encoder models. The system provides intelligent autoscaling from zero, model caching with dynamic adapters for LoRA, and an OpenAI-compatible API interface while requiring no external dependencies like Istio or Knative.
Frequently asked
- What is kubeai-project/kubeai?
- A Kubernetes operator that deploys and scales ML inference servers including vLLM, Ollama, FasterWhisper, and embedding models.
- Is kubeai open source?
- Yes — kubeai-project/kubeai is open source, released under the Apache-2.0 license.
- What language is kubeai written in?
- kubeai-project/kubeai is primarily written in Go.
- How popular is kubeai?
- kubeai-project/kubeai has 1.2k stars on GitHub.
- Where can I find kubeai?
- kubeai-project/kubeai is on GitHub at https://github.com/kubeai-project/kubeai.