mercari/ml-system-design-pattern
A collection of production ML system architecture patterns covering serving strategies, microservices design, caching, and operational workflows.

This repository documents system design patterns for training, serving, and operating machine learning systems in production. It covers serving patterns including synchronous, asynchronous, batch, and microservice architectures, as well as caching and data handling patterns. The patterns are designed to be cloud and Kubernetes compatible, and largely language-agnostic. This serves as educational documentation for ML engineering teams building scalable production ML systems.
Frequently asked
- What is mercari/ml-system-design-pattern?
- A collection of production ML system architecture patterns covering serving strategies, microservices design, caching, and operational workflows.
- Is ml-system-design-pattern open source?
- Yes — mercari/ml-system-design-pattern is open source, released under the MIT license.
- How popular is ml-system-design-pattern?
- mercari/ml-system-design-pattern has 2.9k stars on GitHub.
- Where can I find ml-system-design-pattern?
- mercari/ml-system-design-pattern is on GitHub at https://github.com/mercari/ml-system-design-pattern.