lucidrains/robotic-transformer-pytorch
PyTorch implementation of RT1 (Robotic Transformer), a vision-language-action model for robot control.
Not currently ranked — collecting fresh signals.
star history
This repository implements RT1 (Robotic Transformer) from Google Robotics in PyTorch. The model takes video frames and natural language instructions as input and outputs robot actions for real-world control tasks. It uses a MaxViT backbone with cross-attention conditioning and supports classifier-free guidance during inference. The architecture processes sequences of video frames combined with text instructions to generate motor actions.
Frequently asked
- What is lucidrains/robotic-transformer-pytorch?
- PyTorch implementation of RT1 (Robotic Transformer), a vision-language-action model for robot control.
- Is robotic-transformer-pytorch open source?
- Yes — lucidrains/robotic-transformer-pytorch is open source, released under the MIT license.
- What language is robotic-transformer-pytorch written in?
- lucidrains/robotic-transformer-pytorch is primarily written in Python.
- How popular is robotic-transformer-pytorch?
- lucidrains/robotic-transformer-pytorch has 452 stars on GitHub.
- Where can I find robotic-transformer-pytorch?
- lucidrains/robotic-transformer-pytorch is on GitHub at https://github.com/lucidrains/robotic-transformer-pytorch.