Can I introduce my boyfriend to my grandmother? Evaluating Large Language Models Capabilities on Iranian Social Norm Classification

Understand

Creating globally inclusive AI systems demands datasets reflecting diverse social norms.

• Iran, with its unique cultural blend, offers an ideal case study, with Farsi adding linguistic complexity.
• In this work, we introduce the Iranian Social Norms (ISN) dataset, a novel collection of 1,699 Iranian social norms, including environments, demographic features, and scope annotation, alongside English translations.
• Our evaluation of 6 Large Language Models (LLMs) in classifying Iranian social norms, using a variety of prompts, uncovered critical insights into the impact of geographic and linguistic context.