ai-evals-course/evals-skills
A collection of skills that guide AI coding agents to help users build product-specific AI evaluations.

The repository provides modular skills (evals-start, eval-audit, error-discovery, generate-synthetic-data, write-code) that an AI coding agent can invoke to assist developers in building and auditing product-specific AI evals. It is installed via the npx skills CLI and routes users to the appropriate skill based on their situation, such as auditing an existing eval pipeline or analyzing traces to discover failure modes. The project is associated with the AI Evals course by Parlance Labs.
Frequently asked
- What is ai-evals-course/evals-skills?
- A collection of skills that guide AI coding agents to help users build product-specific AI evaluations.
- Is evals-skills open source?
- Yes — ai-evals-course/evals-skills is open source, released under the Apache-2.0 license.
- How popular is evals-skills?
- ai-evals-course/evals-skills has 1.3k stars on GitHub.
- Where can I find evals-skills?
- ai-evals-course/evals-skills is on GitHub at https://github.com/ai-evals-course/evals-skills.