← all repositories
brianspiering/awesome-dl4nlp

A reading list for when NLP was still mostly RNNs

A curated index of courses, papers, and frameworks for deep learning in NLP, frozen roughly around 2017–2019.

awesome-dl4nlp
Velocity · 7d
+0.4
★ / day
Trend
steady
star history

What it does

This is an “awesome list” — a manually curated index of resources for applying deep learning to natural language processing. It catalogs courses (Stanford CS224N, CMU, Oxford), books, tutorials, talks, frameworks, papers, datasets, and word embedding methods. Think of it as a syllabus someone assembled by hand before LLMs made syllabi feel quaint.

The interesting bit

The list is a time capsule. It captures NLP’s transition from word2vec and LSTMs to the first Transformer implementations, with BERT appearing as a fresh addition. The value isn’t in any single link but in the editorial shape: someone bothered to separate general frameworks (Keras, PyTorch) from NLP-specific ones (AllenNLP, Flair, fairseq) and to flag which courses include actual code.

Key highlights

  • Three full university courses with video lectures, slides, and code repositories
  • Framework section split by backend: TensorFlow (SyntaxNet, BERT) vs. PyTorch (PyText, fairseq, the “Annotated Transformer”)
  • Papers section mixes foundational work (word2vec, seq2seq) with application papers (Smart Reply, ActiveQA)
  • Includes practical resources: Google’s text classification guide, PyTorch’s NLP tutorial, multiple book-length treatments
  • Curator’s editorial voice visible in annotations like “Probably the best ‘book’ on DL for NLP” for CS224N notes

Caveats

  • Last major update appears to be 2019; post-Transformer explosion (GPT-3, instruction tuning, RLHF) is absent
  • Some links are already drifting: TensorFlow’s Mandelbrot tutorial listed under “Talks” is clearly a copy-paste error
  • Heavy Amazon affiliate-style linking for books without disclosure

Verdict

Useful if you’re trying to reconstruct how NLP practitioners learned their craft circa 2017–2019, or if you need a structured starting point that predates the “just use a 70B parameter model” era. Skip it if you need current best practices or LLM-specific guidance — this is archaeology, not engineering.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.