jlin816/dynalang
Dynalang is an agent that uses language to predict future states in reinforcement learning environments via a multimodal world model.

Velocity · 7d
+0.4
★ / day
Trend
→steady
star history
This repository contains the code for Dynalang, an agent that leverages diverse types of language to solve tasks by using language to predict the future via a multimodal world model. It processes both visual observations and language input to learn world dynamics in reinforcement learning settings. The system is evaluated across multiple environments including HomeGrid, Messenger, and VLN (Vision-Language Navigation).