XueFuzhao/OpenMoE
OpenMoE releases open-sourced Mixture-of-Experts Large Language Models, including an 8B base model and chat model.
Not currently ranked — collecting fresh signals.
star history
OpenMoE is a family of open-sourced Mixture-of-Experts (MoE) Large Language Models. The project releases model weights, training data, strategies, and model architecture to the community. It includes OpenMoE-base and 8B variants, with explorations toward 34B scale models. The team provides training code and checkpoints along with a research paper analyzing routing behavior in MoE architectures.
Frequently asked
- What is XueFuzhao/OpenMoE?
- OpenMoE releases open-sourced Mixture-of-Experts Large Language Models, including an 8B base model and chat model.
- Is OpenMoE open source?
- Yes — XueFuzhao/OpenMoE is an open-source project tracked on heatdrop.
- What language is OpenMoE written in?
- XueFuzhao/OpenMoE is primarily written in Python.
- How popular is OpenMoE?
- XueFuzhao/OpenMoE has 1.7k stars on GitHub.
- Where can I find OpenMoE?
- XueFuzhao/OpenMoE is on GitHub at https://github.com/XueFuzhao/OpenMoE.