Cracking the Code of Juxtaposition: Can AI Models Understand the Humorous Contradictions

Understand

Recent advancements in large multimodal language models have demonstrated remarkable proficiency across a wide range of tasks.

• Yet, these models still struggle with understanding the nuances of human humor through juxtaposition, particularly when it involves nonlinear narratives that underpin many jokes and humor cues.
• This paper investigates this challenge by focusing on comics with contradictory narratives, where each comic consists of two panels that create a humorous contradiction.
• We introduce the YesBut benchmark, which comprises tasks of varying difficulty aimed at assessing AI's capabilities in recognizing and interpreting these comics, ranging from literal content comprehension to deep narrative reasoning.