tekaratzas/RustGPT
A transformer-based large language model implemented entirely from scratch in Rust using only ndarray for matrix operations.

Velocity · 7d
+12
★ / day
Trend
→steady
star history
This project provides a complete implementation of a transformer-based language model in pure Rust without external ML frameworks. It includes pre-training on factual text completion, instruction tuning for conversational AI, and an interactive chat mode. The implementation covers full backpropagation with gradient clipping and a modular transformer architecture built from embeddings, transformer blocks, and output projection layers.