tekaratzas/RustGPT
A transformer-based large language model implemented entirely from scratch in Rust using only ndarray for matrix operations.
Not currently ranked — collecting fresh signals.
star history
This project provides a complete implementation of a transformer-based language model in pure Rust without external ML frameworks. It includes pre-training on factual text completion, instruction tuning for conversational AI, and an interactive chat mode. The implementation covers full backpropagation with gradient clipping and a modular transformer architecture built from embeddings, transformer blocks, and output projection layers.
Frequently asked
- What is tekaratzas/RustGPT?
- A transformer-based large language model implemented entirely from scratch in Rust using only ndarray for matrix operations.
- Is RustGPT open source?
- Yes — tekaratzas/RustGPT is open source, released under the MIT license.
- What language is RustGPT written in?
- tekaratzas/RustGPT is primarily written in Rust.
- How popular is RustGPT?
- tekaratzas/RustGPT has 3.1k stars on GitHub.
- Where can I find RustGPT?
- tekaratzas/RustGPT is on GitHub at https://github.com/tekaratzas/RustGPT.