Skip to main content
All terms
Safety & Alignment

Jailbreak

An input crafted to make a model ignore its safety rules and produce content it should refuse.

Definition

A jailbreak is an input designed to trick a model into ignoring its safety guidelines and producing content it should refuse, often using role-play framings, hypothetical scenarios, or encoded instructions. It differs from prompt injection in that the goal is to bypass refusal behavior rather than hijack an agent's actions. Defending against jailbreaks is an ongoing back-and-forth between attackers and model developers.