microsoft/LMOps
Microsoft research platform providing foundational technology for enabling AI capabilities with LLMs and MLLMs.

LMOps is a research initiative focused on general-purpose technology for building AI products with foundation models, specifically targeting LLMs and generative AI systems. It provides implementations and research across multiple areas: automatic prompt optimization, universal prompt retrieval, in-context demonstration selection, structured prompting for longer contexts, LLM alignment techniques, lossless inference acceleration, and domain adaptation. The project supports the broader Microsoft ecosystem including UNILM for pretraining and TorchScale for large-scale transformers.