← all repositories

ai-evals-course/evals-skills

A collection of skills that guide AI coding agents to help users build product-specific AI evaluations.

evals-skills
Collecting fresh signals — velocity needs a few days of history.
collecting data…
star history

The repository provides modular skills (evals-start, eval-audit, error-discovery, generate-synthetic-data, write-code) that an AI coding agent can invoke to assist developers in building and auditing product-specific AI evals. It is installed via the npx skills CLI and routes users to the appropriate skill based on their situation, such as auditing an existing eval pipeline or analyzing traces to discover failure modes. The project is associated with the AI Evals course by Parlance Labs.

Frequently asked

What is ai-evals-course/evals-skills?
A collection of skills that guide AI coding agents to help users build product-specific AI evaluations.
Is evals-skills open source?
Yes — ai-evals-course/evals-skills is open source, released under the Apache-2.0 license.
How popular is evals-skills?
ai-evals-course/evals-skills has 1.3k stars on GitHub.
Where can I find evals-skills?
ai-evals-course/evals-skills is on GitHub at https://github.com/ai-evals-course/evals-skills.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.