CyberBattleSim is a research experimentation platform that simulates enterprise network environments where automated agents interact. The platform uses Open AI Gym interfaces to enable training of reinforcement learning agents, specifically attacker agents that exploit vulnerabilities to move laterally through a network and defender agents that detect and mitigate attacks by re-imaging compromised nodes. The simulation abstracts network topology and cyber security concepts to study multi-agent interactions and RL algorithm performance.