← all repositories
uptrain-ai/uptrain

LLM report cards that explain the bad grades

UpTrain grades generative AI applications with 20+ automated checks and diagnoses why they fail.

2.4k stars Python LLMOps · EvalAgents
uptrain
Not currently ranked — collecting fresh signals.
star history

What it does UpTrain is an open-source Python platform for evaluating and improving generative AI applications. It runs 20+ preconfigured checks across language, code, and embedding use cases and assigns grades. When checks fail, it performs root-cause analysis and suggests how to resolve the issue.

The interesting bit Most evaluation tools hand back a score and leave you to debug; UpTrain treats the grade as the beginning of the investigation. That is a useful shift for teams tired of staring at failing prompts with no obvious culprit.

Key highlights

  • 20+ built-in evaluations covering language, code, and embedding scenarios
  • Root-cause analysis with remediation guidance for failure cases
  • Interactive dashboards for visualizing results
  • Explicit checks for hallucinations, jailbreaks, and retrieved-context quality

Verdict Worth a look if you need structured, repeatable diagnostics for LLM features in production or staging. Skip it if you just want a lightweight, one-off prompt comparator.

Frequently asked

What is uptrain-ai/uptrain?
UpTrain grades generative AI applications with 20+ automated checks and diagnoses why they fail.
Is uptrain open source?
Yes — uptrain-ai/uptrain is open source, released under the Apache-2.0 license.
What language is uptrain written in?
uptrain-ai/uptrain is primarily written in Python.
How popular is uptrain?
uptrain-ai/uptrain has 2.4k stars on GitHub.
Where can I find uptrain?
uptrain-ai/uptrain is on GitHub at https://github.com/uptrain-ai/uptrain.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.