Prompting for Multimodal Hateful Meme Classification

Understand

Hateful meme classification is a challenging multimodal task that requires complex reasoning and contextual background knowledge.

• Ideally, we could leverage an explicit external knowledge base to supplement contextual and cultural information in hateful memes.
• However, there is no known explicit external knowledge base that could provide such hate speech contextual information.
• To address this gap, we propose PromptHate, a simple yet effective prompt-based model that prompts pre-trained language models (PLMs) for hateful meme classification.