Dolma provides an open dataset of 3 trillion tokens sourced from web content, academic publications, code, books, and encyclopedic materials. The accompanying toolkit enables high-performance dataset curation for language model training with built-in parallelism and ready-to-use taggers for common filtering strategies like Gopher, C4, and OpenWebText.