mattpocock/evalite
A TypeScript-native evaluation framework for testing LLM-powered applications locally.

Velocity · 7d
+2.8
★ / day
Trend
→steady
star history
Evalite is a local-first testing tool designed for evaluating LLM-powered applications built with TypeScript. It provides utilities for running eval suites on prompts, chains, and agents, with a watch mode and UI for iterating on tests. The tool focuses on helping developers catch regressions in their AI application behavior during development.