replicate/cog
Cog is an open-source tool that packages machine learning models in production-ready Docker containers.

Velocity · 7d
+4.9
★ / day
Trend
→steady
star history
Cog simplifies ML model deployment by generating Docker images from a simple configuration file, handling CUDA/cuDNN/PyTorch/TensorFlow compatibility automatically. It generates OpenAPI schemas from Python type hints and creates a high-performance Rust/Axum HTTP inference server based on model inputs and outputs. Models can be deployed to any Docker-compatible infrastructure or to Replicate’s platform.