← all repositories

SeldonIO/MLServer

An open source inference server for machine learning models, providing REST and gRPC APIs compliant with the KFServing V2 protocol.

889 stars Python Inference · Serving
MLServer
Velocity · 7d
+0.4
★ / day
Trend
steady
star history

MLServer is a Python-based inference server that lets you serve ML models through a REST and gRPC interface. It supports multi-model serving, parallel inference, and adaptive batching for performance optimization. The server is designed to run in Kubernetes environments and integrates with Seldon Core and KServe as the underlying model serving infrastructure. It is compliant with the standardized V2 Inference Protocol used across multiple ML serving frameworks.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.