← all repositories

hkproj/pytorch-transformer

A PyTorch implementation of the Transformer architecture introduced in the 2017 'Attention is all you need' paper.

1.3k stars Jupyter Notebook LearningLanguage Models
pytorch-transformer
Not currently ranked — collecting fresh signals.
star history

This repository contains a step-by-step implementation of the Transformer model, the neural network architecture that powers modern large language models. Built in PyTorch as a Jupyter Notebook, it serves as a learning resource for understanding self-attention mechanisms, encoder-decoder structures, and positional encodings. The implementation is accompanied by a YouTube walkthrough video.

Frequently asked

What is hkproj/pytorch-transformer?
A PyTorch implementation of the Transformer architecture introduced in the 2017 'Attention is all you need' paper.
Is pytorch-transformer open source?
Yes — hkproj/pytorch-transformer is an open-source project tracked on heatdrop.
What language is pytorch-transformer written in?
hkproj/pytorch-transformer is primarily written in Jupyter Notebook.
How popular is pytorch-transformer?
hkproj/pytorch-transformer has 1.3k stars on GitHub.
Where can I find pytorch-transformer?
hkproj/pytorch-transformer is on GitHub at https://github.com/hkproj/pytorch-transformer.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.