Ten notebooks that trace NLP's evolution from counting to attention
A curated, intuition-first curriculum that shows why NLP evolved from bag-of-words to self-attention, not just how to import the latest library.

What it does
This repository is a collection of ten Jupyter notebooks that form a guided curriculum in natural language processing. It starts with tokenization and classical techniques like bag-of-words and TF-IDF, progresses through Naive Bayes and topic modeling, and ends with word embeddings, RNNs, attention, and Transformers. The material is built to run in Google Colab or Kaggle, so you can ignore your local GPU situation.
The interesting bit
The notebooks are sequenced to mirror the field’s actual history—counting words, then adding statistics, then neural networks, then self-attention—so you understand why each technique was necessary. The author emphasizes “core intuition” over black-box library calls, which is rarer than it should be in tutorial repositories.
Key highlights
- Ten sequential notebooks covering NLP from preprocessing to Transformers
- Mixes classical ML (LDA, Naive Bayes) with deep learning (RNNs, Attention, Transformers)
- Explicitly designed for cloud kernels; no local setup required
- Focuses on conceptual evolution and intuition rather than API syntax
- MIT licensed
Caveats
- Several notebooks rely on gigabyte-scale Kaggle datasets that do not auto-attach; you must manually link them before running
- Assumes you already know basic Python; this is not a programming primer
- The code is pedagogical by design, so don’t expect production-hardened pipelines or novel architectures
Verdict
Worth bookmarking if you want a structured, historical tour of NLP fundamentals without wrangling CUDA drivers. Give it a pass if you need a reusable framework or pre-trained model weights.
Frequently asked
- What is JUSTSUJAY/nlp-zero-to-hero?
- A curated, intuition-first curriculum that shows why NLP evolved from bag-of-words to self-attention, not just how to import the latest library.
- Is nlp-zero-to-hero open source?
- Yes — JUSTSUJAY/nlp-zero-to-hero is open source, released under the MIT license.
- What language is nlp-zero-to-hero written in?
- JUSTSUJAY/nlp-zero-to-hero is primarily written in Jupyter Notebook.
- How popular is nlp-zero-to-hero?
- JUSTSUJAY/nlp-zero-to-hero has 595 stars on GitHub.
- Where can I find nlp-zero-to-hero?
- JUSTSUJAY/nlp-zero-to-hero is on GitHub at https://github.com/JUSTSUJAY/nlp-zero-to-hero.