brightmart/bert_language_understanding
A TensorFlow implementation of BERT that reproduces Google's pre-training approach for language understanding tasks.
Not currently ranked — collecting fresh signals.
star history
The repository replicates BERT’s pre-training strategy and experiments with replacing the Transformer backbone with TextCNN. It implements masked language model pre-training and fine-tuning for various NLP tasks such as text classification, document classification, and question answering. The work demonstrates that the pre-train and fine-tuning paradigm is model-independent and can boost performance significantly even with moderate-sized datasets.
Frequently asked
- What is brightmart/bert_language_understanding?
- A TensorFlow implementation of BERT that reproduces Google's pre-training approach for language understanding tasks.
- Is bert_language_understanding open source?
- Yes — brightmart/bert_language_understanding is an open-source project tracked on heatdrop.
- What language is bert_language_understanding written in?
- brightmart/bert_language_understanding is primarily written in Python.
- How popular is bert_language_understanding?
- brightmart/bert_language_understanding has 965 stars on GitHub.
- Where can I find bert_language_understanding?
- brightmart/bert_language_understanding is on GitHub at https://github.com/brightmart/bert_language_understanding.