TMRL is a Python library that facilitates the implementation of reinforcement learning pipelines for robotics and real-time control. It provides a distributed framework compatible with Gymnasium environments and implements algorithms like Soft Actor-Critic (SAC) with PyTorch. The project includes example pipelines for training AI agents in the TrackMania 2020 video game as a self-driving use case.