This repository implements diffusion models for flexible behavior synthesis in reinforcement learning settings. It provides code for training diffusion policies and planning through value-function guided sampling on D4RL locomotion tasks, block-stacking (KUKA), and Maze2D goal-reaching via inpainting. The project includes pretrained model downloads and integrates with the Hugging Face Diffusers ecosystem.