Prompt injection
Getting a language model to follow instructions it was not supposed to follow, by placing those instructions somewhere the model treats as input. The root cause is that a model sees one undifferentiated stream of text: the developer's system prompt, the user's question, a web page it fetched and a file it read all arrive as tokens, with no reliable structural marker saying which of them is allowed to give orders. It splits into two shapes with very different threat models — direct and indirect.
See also jailbreak · OWASP LLM01 · confused deputy
Related terms
-
Jailbreak
Attack concepts
Defeating a model's safety training so it produces output it would normally refuse. The distinction from prompt injection is about whose intent is being…
-
OWASP LLM Top 10
Frameworks & standards
OWASP's list of the ten most critical risks in applications built on large language models — LLM01 Prompt Injection, LLM02 Sensitive Information…
-
Confused deputy
Attack concepts
A classic security problem, dated 1988, that agents reproduce almost perfectly: a privileged component is tricked by a less-privileged party into misusing…
Attack concepts
The mechanisms the families above exploit, plus the agent-specific ones that have no chatbot equivalent. If you only read one entry on this page, read indirect prompt injection.