mattpocock/evalite
A TypeScript-native evaluation framework for testing LLM-powered applications locally.
Not currently ranked — collecting fresh signals.
star history
Evalite is a local-first testing tool designed for evaluating LLM-powered applications built with TypeScript. It provides utilities for running eval suites on prompts, chains, and agents, with a watch mode and UI for iterating on tests. The tool focuses on helping developers catch regressions in their AI application behavior during development.
Frequently asked
- What is mattpocock/evalite?
- A TypeScript-native evaluation framework for testing LLM-powered applications locally.
- Is evalite open source?
- Yes — mattpocock/evalite is open source, released under the MIT license.
- What language is evalite written in?
- mattpocock/evalite is primarily written in TypeScript.
- How popular is evalite?
- mattpocock/evalite has 1.6k stars on GitHub.
- Where can I find evalite?
- mattpocock/evalite is on GitHub at https://github.com/mattpocock/evalite.