Self-Deception: Reverse Penetrating the Semantic Firewall of Large Language Models

Understand

Large language models (LLMs), such as ChatGPT, have emerged with astonishing capabilities approaching artificial general intelligence.

• While providing convenience for various societal needs, LLMs have also lowered the cost of generating harmful content.
• Consequently, LLM developers have deployed semantic-level defenses to recognize and reject prompts that may lead to inappropriate content.
• Unfortunately, these defenses are not foolproof, and some attackers have crafted "jailbreak" prompts that temporarily hypnotize the LLM into forgetting content defense rules and answering any improper questions.