ShieldAgent: Shielding Agents via Verifiable Safety Policy Reasoning

Understand

Autonomous agents powered by foundation models have seen widespread adoption across various real-world applications.

• However, they remain highly vulnerable to malicious instructions and attacks, which can result in severe consequences such as privacy breaches and financial losses.
• More critically, existing guardrails for LLMs are not applicable due to the complex and dynamic nature of agents.
• To tackle these challenges, we propose ShieldAgent, the first guardrail agent designed to enforce explicit safety policy compliance for the action trajectory of other protected agents through logical reasoning.