salesforce/xgen
A 7B parameter open-source large language model family supporting up to 8K input sequence length, released by Salesforce AI Research.
Not currently ranked — collecting fresh signals.
star history
XGen provides three model variants: XGen-7B-4K-Base, XGen-7B-8K-Base, and XGen-7B-8K-Inst (instruction-finetuned). The models are trained to handle long sequences up to 8K tokens and can be loaded via the HuggingFace transformers library for auto-regressive text generation. They use the OpenAI Tiktoken tokenizer for subword tokenization.
Frequently asked
- What is salesforce/xgen?
- A 7B parameter open-source large language model family supporting up to 8K input sequence length, released by Salesforce AI Research.
- Is xgen open source?
- Yes — salesforce/xgen is open source, released under the Apache-2.0 license.
- What language is xgen written in?
- salesforce/xgen is primarily written in Python.
- How popular is xgen?
- salesforce/xgen has 727 stars on GitHub.
- Where can I find xgen?
- salesforce/xgen is on GitHub at https://github.com/salesforce/xgen.