femtoGPT is a from-scratch implementation of a Generative Pretrained Transformer written in pure Rust. It supports both training and inference on CPU and GPU (via OpenCL). All tensor operations and neural network layers are implemented manually without external ML frameworks, making it a learning tool for understanding how LLMs work internally. Gradient correctness is verified using gradient checking.