algorithmicsuperintelligence/optillm
An OpenAI API-compatible proxy server that applies inference-time optimization techniques to improve LLM accuracy on reasoning tasks.
Not currently ranked — collecting fresh signals.
star history
OptiLLM is an inference proxy that implements over 20 state-of-the-art optimization techniques to improve LLM accuracy on math, coding, and logical reasoning tasks without any model training or fine-tuning. It acts as a drop-in replacement for OpenAI-compatible endpoints, adding techniques like Monte Carlo Tree Search, best-of-N sampling, and chain-of-thought prompting. The proxy works with any OpenAI-compatible API provider and applies multiple inference-time compute strategies to boost performance.
Frequently asked
- What is algorithmicsuperintelligence/optillm?
- An OpenAI API-compatible proxy server that applies inference-time optimization techniques to improve LLM accuracy on reasoning tasks.
- Is optillm open source?
- Yes — algorithmicsuperintelligence/optillm is open source, released under the Apache-2.0 license.
- What language is optillm written in?
- algorithmicsuperintelligence/optillm is primarily written in Python.
- How popular is optillm?
- algorithmicsuperintelligence/optillm has 4.2k stars on GitHub.
- Where can I find optillm?
- algorithmicsuperintelligence/optillm is on GitHub at https://github.com/algorithmicsuperintelligence/optillm.