IDSIA/sacred
An ML experiment tracking and reproducibility framework with config management, observers, and database logging.

Sacred is a Python tool for managing machine learning experiments. It provides config scopes to define experiment parameters, config injection for accessing parameters across functions, a command-line interface for running different experiment variants, and observers that log experiment details to MongoDB. It also includes automatic seeding for reproducibility. The tool is specifically designed to handle the tedious overhead around actual ML experiments, including tracking parameters, saving configurations, and reproducing results.