AI models and agents
Prompt injection
Also known as: instruction injection
An attempt to change AI behavior through instructions hidden in untrusted data.
A practical example
A document contains instructions to ignore the user's task.
What should I know?
Source content should not grant action permissions by itself.
AI models and agents in practice
A model processes information; the application defines tools and permissions. Reliable answers require good sources and verification. Actions involving accounts, content, and orders must stay within the granted scope.
Related Semly features
See where this concept applies when working with Semly.
Related terms
Documentation and further reading
Definition prepared by Semly. Standards and behavior are described by their creators: