← all repositories

tophant-ai/promptbeat

Promptbeat is a scenario-driven safety evaluation toolkit for testing LLMs and agent applications against adversarial cases.

608 stars MDX LLMOps · EvalAgents
promptbeat
Velocity · 7d
+20
★ / day
Trend
steady
star history

Promptbeat provides a framework for evaluating the security boundaries of LLMs and agent systems by generating adversarial test cases from targets, scenarios, seeds, and dataset subscriptions. It executes attacks against real model or agent targets and evaluates their safety responses. The repository contains documentation, configuration examples, and seed-source subscription templates for dataset-driven evaluation campaigns.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.