wgryc/phasellm
A Python framework for evaluating and comparing large language models from OpenAI, Cohere, Anthropic and other providers with standardized APIs and evaluation workflows.
Not currently ranked — collecting fresh signals.
star history
PhaseLLM is a framework for evaluating and managing LLM-driven products and experiences. It standardizes API calls across multiple LLM providers (OpenAI, Cohere, Anthropic) to enable model comparison and benchmarking. The framework includes evaluation tools to assess output quality and automations to use advanced models like GPT-4 to evaluate simpler models, helping users optimize prompts and model selection based on performance and cost.
Frequently asked
- What is wgryc/phasellm?
- A Python framework for evaluating and comparing large language models from OpenAI, Cohere, Anthropic and other providers with standardized APIs and evaluation workflows.
- Is phasellm open source?
- Yes — wgryc/phasellm is open source, released under the MIT license.
- What language is phasellm written in?
- wgryc/phasellm is primarily written in Python.
- How popular is phasellm?
- wgryc/phasellm has 458 stars on GitHub.
- Where can I find phasellm?
- wgryc/phasellm is on GitHub at https://github.com/wgryc/phasellm.