← all repositories

tekaratzas/RustGPT

A transformer-based large language model implemented entirely from scratch in Rust using only ndarray for matrix operations.

3.1k stars Rust Language Models
RustGPT
Velocity · 7d
+12
★ / day
Trend
steady
star history

This project provides a complete implementation of a transformer-based language model in pure Rust without external ML frameworks. It includes pre-training on factual text completion, instruction tuning for conversational AI, and an interactive chat mode. The implementation covers full backpropagation with gradient clipping and a modular transformer architecture built from embeddings, transformer blocks, and output projection layers.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.