StruQ: Defending Against Prompt Injection with Structured Queries

Understand

Recent advances in Large Language Models (LLMs) enable exciting LLM-integrated applications, which perform text-based tasks by utilizing their advanced language understanding capabilities.

• However, as LLMs have improved, so have the attacks against them.
• Prompt injection attacks are an important threat: they trick the model into deviating from the original application's instructions and instead follow user directives.
• These attacks rely on the LLM's ability to follow instructions and inability to separate prompts and user data.