This repository contains code for the paper ‘Evolution Strategies as a Scalable Alternative to Reinforcement Learning.’ It implements a distributed master-worker architecture where the master broadcasts parameters to workers and receives returns. The implementation is designed to run on EC2 using AWS spot instances for cost-effective distributed training, supporting experiments like humanoid scaling as described in the original paper.