Reinforcejs is a JavaScript reinforcement learning library by Andrej Karpathy implementing common RL algorithms such as Dynamic Programming, Temporal Difference Learning (SARSA/Q-Learning), and Deep Q-Networks. It also includes stochastic and deterministic policy gradient methods with actor-critic architectures for continuous action spaces. The library includes its own expression graph and automatic backpropagation utilities for building neural networks.