zihangdai/xlnet
Official implementation of XLNet, a transformer-based language model using permutation language modeling for natural language understanding.
Not currently ranked — collecting fresh signals.
star history
XLNet provides an unsupervised language representation learning method based on a generalized permutation language modeling objective. It uses Transformer-XL as its backbone architecture, enabling effective handling of long-range dependencies in text. The model achieves state-of-the-art results on diverse downstream NLP tasks including question answering, text classification, natural language inference, and document ranking, outperforming BERT on 20 tasks.
Frequently asked
- What is zihangdai/xlnet?
- Official implementation of XLNet, a transformer-based language model using permutation language modeling for natural language understanding.
- Is xlnet open source?
- Yes — zihangdai/xlnet is open source, released under the Apache-2.0 license.
- What language is xlnet written in?
- zihangdai/xlnet is primarily written in Python.
- How popular is xlnet?
- zihangdai/xlnet has 6.2k stars on GitHub.
- Where can I find xlnet?
- zihangdai/xlnet is on GitHub at https://github.com/zihangdai/xlnet.