CStanKonrad/long_llama
A 3B–7B parameter large language model designed to process extended context windows beyond standard LLM limitations.
Not currently ranked — collecting fresh signals.
star history
LongLLaMA extends OpenLLaMA’s context length capabilities through Focused Transformer (FoT) fine-tuning, enabling the model to handle significantly longer input sequences than typical language models. The project provides model weights on HuggingFace and includes instruction-tuned variants (Instruct and Code versions) with Colab notebooks for easy experimentation.
Frequently asked
- What is CStanKonrad/long_llama?
- A 3B–7B parameter large language model designed to process extended context windows beyond standard LLM limitations.
- Is long_llama open source?
- Yes — CStanKonrad/long_llama is open source, released under the Apache-2.0 license.
- What language is long_llama written in?
- CStanKonrad/long_llama is primarily written in Python.
- How popular is long_llama?
- CStanKonrad/long_llama has 1.5k stars on GitHub.
- Where can I find long_llama?
- CStanKonrad/long_llama is on GitHub at https://github.com/CStanKonrad/long_llama.