This repository provides a comprehensive stack for creating and interacting with physics-based RL environments. It includes Python bindings to the MuJoCo physics engine, a suite of benchmark RL tasks for continuous control, utilities for composing custom environments from reusable components, and multi-agent soccer environments. The package supports training and evaluating autonomous agents in simulated physical domains.