← all repositories

autoliuweijie/K-BERT

K-BERT is a knowledge-graph-enhanced BERT model for improved language representation, published at AAAI 2020.

985 stars Python Language ModelsML Frameworks
K-BERT
Velocity · 7d
+0.4
★ / day
Trend
steady
star history

K-BERT extends BERT by injecting knowledge from knowledge graphs (CNDbpedia, HowNet, Medical) into the embedding process, enabling richer contextual representations. The implementation is built on the UER-py framework and supports downstream tasks like text classification and named entity recognition. Users download a pre-trained Google BERT model and knowledge base files to run classification and NER pipelines.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.