← all repositories

Leeroo-AI/mergoo

A Python library for merging multiple fine-tuned LLM experts into unified models with efficient training support.

516 stars Python Language ModelsML Frameworks
mergoo
Velocity · 7d
+0.7
★ / day
Trend
steady
star history

Mergoo provides tooling to combine multiple specialized LLM experts (e.g., domain-specific or fine-tuned adapters) into a single model. It supports Mixture-of-Experts (MoE) and Mixture-of-Adapters (MoA) merging strategies, as well as layer-wise merging for fine-grained control. The library integrates with HuggingFace Transformers and PEFT for training, allowing users to either train only the routing layers or perform full fine-tuning of the merged model on standard hardware including CPU, MPS, and GPU.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.