SeldonIO/seldon-core
A Kubernetes-native MLOps/LLMOps platform for deploying, managing and scaling production AI models at scale.

Seldon Core is an open-source framework for packaging, deploying, monitoring and managing machine learning models in production Kubernetes environments. It provides standardized deployment across diverse model types, supports composable AI pipelines with Kafka-based realtime streaming, and includes autoscaling for models and application components. The platform handles the operational complexities of running AI systems at scale, including performance tuning and observability.