This project presents a method for progressively extending LLaMA models by inserting and training new transformer blocks, enabling efficient model capacity expansion without full retraining. The work includes released model weights on HuggingFace and demonstrates improvements on code and math benchmarks. Extensions to Mistral models are also provided.