hkproj/pytorch-transformer
A PyTorch implementation of the Transformer architecture introduced in the 2017 'Attention is all you need' paper.

Not currently ranked — collecting fresh signals.
star history
This repository contains a step-by-step implementation of the Transformer model, the neural network architecture that powers modern large language models. Built in PyTorch as a Jupyter Notebook, it serves as a learning resource for understanding self-attention mechanisms, encoder-decoder structures, and positional encodings. The implementation is accompanied by a YouTube walkthrough video.
Frequently asked
- What is hkproj/pytorch-transformer?
- A PyTorch implementation of the Transformer architecture introduced in the 2017 'Attention is all you need' paper.
- Is pytorch-transformer open source?
- Yes — hkproj/pytorch-transformer is an open-source project tracked on heatdrop.
- What language is pytorch-transformer written in?
- hkproj/pytorch-transformer is primarily written in Jupyter Notebook.
- How popular is pytorch-transformer?
- hkproj/pytorch-transformer has 1.3k stars on GitHub.
- Where can I find pytorch-transformer?
- hkproj/pytorch-transformer is on GitHub at https://github.com/hkproj/pytorch-transformer.