Voyager is an open-ended embodied learning agent in Minecraft that continuously explores, acquires diverse skills, and makes discoveries without human intervention. It uses GPT-4 via blackbox queries and consists of three components: an automatic curriculum for exploration, an ever-growing skill library of executable code, and an iterative prompting mechanism with environment feedback and self-verification. The agent develops interpretable, compositional skills that compound abilities and avoid catastrophic forgetting.