← all repositories
huggingface/lerobot

Hugging Face's PyTorch toolkit for real robot learning

LeRobot standardizes datasets, policies, and hardware control so you can train ACT or VLA models on real arms without rebuilding the plumbing each time.

24.8k stars Python Domain AppsML Frameworks
lerobot
Velocity · 7d
+29
★ / day
Trend
steady
star history

What it does LeRobot is a PyTorch-native library that wraps the messy pipeline of real-world robotics—hardware control, dataset management, policy training, and evaluation—into a single, extensible stack. It targets everything from sub-$200 SO-100 arms to Unitree G1 humanoids, with a unified Robot class that decouples your control logic from motor drivers and USB IDs.

The interesting bit The project treats robotics data like Hugging Face treats NLP datasets: a standardized LeRobotDataset format (Parquet for state/action, MP4 for vision) lives on the Hub, streamable and mergeable. That sounds bureaucratic until you realize it means you can pull down thousands of episodes, delete bad ones by index, and start training ACT or Pi0Fast without writing a custom dataloader.

Key highlights

  • Ships with 9+ policy families in pure PyTorch: imitation learning (ACT, Diffusion, VQ-BeT), RL (HIL-SERL, TDMPC), and VLAs (GR00T N1.5, SmolVLA, Pi0Fast, Pi0.5, XVLA)
  • Hardware abstraction supports 11+ platforms natively, with a documented interface for adding your own
  • One-line training via lerobot-train --policy=act --dataset.repo_id=... and evaluation via lerobot-eval against LIBERO or MetaWorld
  • Datasets handle video decoding automatically; no manual frame extraction
  • ICLR 2026 publication backing the architecture

Caveats

  • Several listed models (QC-FQL) and benchmarks are marked “coming soon”
  • GPU/RAM requirements and training times vary significantly by policy; check the Compute Hardware Guide before picking a model
  • Real hardware setup still requires per-robot configuration, though the docs are extensive

Verdict Grab this if you’re doing end-to-end learning on physical robots and tired of rewriting the glue between your camera, arm, and diffusion policy. Skip it if you’re only simulating in Isaac Gym and don’t need the hardware abstraction or dataset Hub integration.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.