Prompt Injection
Prompt injection is an attack technique where crafted input manipulates a large language model into ignoring its original instructions or safety constraints and instead following instructions embedded in the attacker-controlled input. It exploits the fact that LLMs process instructions and data in the same text…
5 resources across 1 library
Glossary Terms(5)
OWASP
OWASP (Open Worldwide Application Security Project) is a nonprofit foundation dedicated to improving software security through open, community-driven resources…
Prompt Injection
Prompt injection is an attack technique where crafted input manipulates a large language model into ignoring its original instructions or safety constraints an…
Jailbreak
In the context of AI, a jailbreak is a prompting technique or crafted input designed to bypass an LLM's built-in safety training and content policies, coaxing…
AI Red Teaming
AI red teaming is the practice of systematically probing an AI system — typically a large language model or generative AI product — for security vulnerabilitie…
System Prompt
A system prompt is a set of instructions given to a language model before user input that establishes its role, tone, constraints, and behavior for the remaind…