← all repositories

utkusen/promptmap

An automated prompt injection security scanner for testing custom LLM applications against predefined attack rules.

1.2k stars Python LLMOps · Eval
promptmap
Velocity · 7d
+1.1
★ / day
Trend
steady
star history

Promptmap2 is a security testing tool for custom LLM applications that evaluates their vulnerability to prompt injection and other attack categories. It supports both white-box testing (direct API access) and black-box testing (HTTP endpoint scanning). The tool uses a dual-LLM architecture where a controller LLM analyzes target responses against predefined test conditions to determine if attacks succeeded. It includes 50+ test rules across categories including prompt stealing, jailbreaking, harmful content generation, and bias testing.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.