The book demystifies scaling LLMs on TPUs by explaining TPU architecture, how LLMs run at scale, and how to select parallelism schemes that avoid communication bottlenecks during training and inference. Written by Google DeepMind researchers, it covers technical topics including roofline analysis, tensor parallelism, and pipeline parallelism for large language model systems.