← all repositories

sail-sg/envpool

A C++-based high-performance batched environment pool for accelerating reinforcement learning training workflows.

1.5k stars C++ ML Frameworks
envpool
Velocity · 7d
+0.9
★ / day
Trend
steady
star history

EnvPool is a C++ parallel execution engine that provides vectorized environment execution for reinforcement learning agents. It uses pybind11 for Python bindings and implements a lock-free thread pool for maximum throughput, achieving approximately 1M FPS with Atari games and 3M FPS with MuJoCo on DGX-A100. The project supports Gymnasium and dm_env interfaces in both synchronous and asynchronous modes, covering Atari, MuJoCo, classic control, Box2D, and ViZDoom environments.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.