← all repositories

huggingface/large_language_model_training_playbook

A practical playbook from HuggingFace providing implementation tips and resources for training large language models.

501 stars Python Language ModelsLearning
large_language_model_training_playbook
Velocity · 7d
+0.4
★ / day
Trend
steady
star history

A comprehensive guide covering LLM training topics including model architecture decisions, parallelism strategies, precision management (fp32/fp16/bf16), hyperparameter selection, throughput optimization, training stability debugging, and resource management. Designed as a companion to the LLM Training Handbook.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.