← all repositories
nlp-with-transformers/notebooks

Popular NLP book ships notebooks, plus a frank maintenance log

Companion notebooks for the O'Reilly NLP transformers book, complete with one-click cloud runners and unusually candid obsolescence warnings.

4.8k stars Jupyter Notebook LearningLanguage Models
notebooks
Not currently ranked — collecting fresh signals.
star history

What it does

This repository holds the executable Jupyter notebooks for the O’Reilly book Natural Language Processing with Transformers. Each chapter maps to a notebook covering tasks like text classification, named entity recognition, summarization, and training transformers from scratch. The maintainers provide one-click launch badges for Colab, Kaggle, Gradient, and SageMaker Studio Lab, though most chapters expect a GPU to finish in reasonable time.

The interesting bit

The README is remarkably upfront about decay: it explicitly flags that TensorFlow sections are untested and break under Keras 3, and that Chapter 7’s question-answering stack is abandoned because its dependency tree is incompatible with Python 3.10. That honesty saves you from the usual archaeological dig through stale ML examples.

Key highlights

  • Eleven chapter notebooks, from introduction to training transformers from scratch
  • One-click launchers for four cloud GPU platforms (Colab, Kaggle, Gradient, Studio Lab)
  • PyTorch code paths are actively maintained; TensorFlow paths are legacy-only
  • Chapter 7 concepts (retriever + reader pipelines, dense passage retrieval) remain valid even though the runnable code is deprecated
  • Covers production concerns like model compression and few-to-no-label learning

Caveats

  • TensorFlow/Keras 2 code paths are no longer tested and break against current Keras 3
  • Chapter 7 (Question Answering) is unmaintained due to an upstream deprecation chain (farm-haystack, Elasticsearch 7.x, pydantic 1.x)

Verdict

Worth bookmarking if you are working through the O’Reilly book or need a curated, chapter-by-chapter NLP transformers syllabus. Skip it if you are looking for a standalone, continuously updated tutorial repository; the bit rot is real and documented.

Frequently asked

What is nlp-with-transformers/notebooks?
Companion notebooks for the O'Reilly NLP transformers book, complete with one-click cloud runners and unusually candid obsolescence warnings.
Is notebooks open source?
Yes — nlp-with-transformers/notebooks is open source, released under the Apache-2.0 license.
What language is notebooks written in?
nlp-with-transformers/notebooks is primarily written in Jupyter Notebook.
How popular is notebooks?
nlp-with-transformers/notebooks has 4.8k stars on GitHub.
Where can I find notebooks?
nlp-with-transformers/notebooks is on GitHub at https://github.com/nlp-with-transformers/notebooks.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.