← all repositories

lucidrains/q-transformer

Implementation of Q-Transformer, Google DeepMind's offline reinforcement learning method for robotics using transformer-based autoregressive Q-functions.

407 stars Python Domain AppsAgents
q-transformer
Velocity · 7d
+0.4
★ / day
Trend
steady
star history

This repository provides a PyTorch implementation of Q-Transformer, a method for scalable offline reinforcement learning. It reproduces the autoregressive Q-learning formulation for handling continuous action spaces in robotics applications. The implementation includes a vision transformer backbone for processing high-dimensional observations like images, along with tools for environment interaction, replay memory management, and training agents using Q-learning on discrete action bins.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.