← all repositories

kpe/bert-for-tf2

A TensorFlow/Keras implementation of BERT, ALBERT, and adapter-BERT with pre-trained weight loading support.

807 stars Python Language ModelsML Frameworks
bert-for-tf2
Velocity · 7d
+0.3
★ / day
Trend
steady
star history

This repository provides a Keras implementation of BERT (Bidirectional Encoder Representations from Transformers) for TensorFlow 2.0, with support for loading original pre-trained weights from Google Research. It also supports ALBERT (A Lite BERT) and adapter-BERT through configuration parameters. The implementation builds from scratch using basic TensorFlow operations following the original modeling.py code.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.