utkusen/promptmap
An automated prompt injection security scanner for testing custom LLM applications against predefined attack rules.

Promptmap2 is a security testing tool for custom LLM applications that evaluates their vulnerability to prompt injection and other attack categories. It supports both white-box testing (direct API access) and black-box testing (HTTP endpoint scanning). The tool uses a dual-LLM architecture where a controller LLM analyzes target responses against predefined test conditions to determine if attacks succeeded. It includes 50+ test rules across categories including prompt stealing, jailbreaking, harmful content generation, and bias testing.