kpe/bert-for-tf2
A TensorFlow/Keras implementation of BERT, ALBERT, and adapter-BERT with pre-trained weight loading support.

Velocity · 7d
+0.3
★ / day
Trend
→steady
star history
This repository provides a Keras implementation of BERT (Bidirectional Encoder Representations from Transformers) for TensorFlow 2.0, with support for loading original pre-trained weights from Google Research. It also supports ALBERT (A Lite BERT) and adapter-BERT through configuration parameters. The implementation builds from scratch using basic TensorFlow operations following the original modeling.py code.