A reading list for when NLP was still mostly RNNs
A curated index of courses, papers, and frameworks for deep learning in NLP, frozen roughly around 2017–2019.

What it does
This is an “awesome list” — a manually curated index of resources for applying deep learning to natural language processing. It catalogs courses (Stanford CS224N, CMU, Oxford), books, tutorials, talks, frameworks, papers, datasets, and word embedding methods. Think of it as a syllabus someone assembled by hand before LLMs made syllabi feel quaint.
The interesting bit
The list is a time capsule. It captures NLP’s transition from word2vec and LSTMs to the first Transformer implementations, with BERT appearing as a fresh addition. The value isn’t in any single link but in the editorial shape: someone bothered to separate general frameworks (Keras, PyTorch) from NLP-specific ones (AllenNLP, Flair, fairseq) and to flag which courses include actual code.
Key highlights
- Three full university courses with video lectures, slides, and code repositories
- Framework section split by backend: TensorFlow (SyntaxNet, BERT) vs. PyTorch (PyText, fairseq, the “Annotated Transformer”)
- Papers section mixes foundational work (word2vec, seq2seq) with application papers (Smart Reply, ActiveQA)
- Includes practical resources: Google’s text classification guide, PyTorch’s NLP tutorial, multiple book-length treatments
- Curator’s editorial voice visible in annotations like “Probably the best ‘book’ on DL for NLP” for CS224N notes
Caveats
- Last major update appears to be 2019; post-Transformer explosion (GPT-3, instruction tuning, RLHF) is absent
- Some links are already drifting: TensorFlow’s Mandelbrot tutorial listed under “Talks” is clearly a copy-paste error
- Heavy Amazon affiliate-style linking for books without disclosure
Verdict
Useful if you’re trying to reconstruct how NLP practitioners learned their craft circa 2017–2019, or if you need a structured starting point that predates the “just use a 70B parameter model” era. Skip it if you need current best practices or LLM-specific guidance — this is archaeology, not engineering.