DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures

Understand

Generative models are increasingly being used in various applications, such as text generation, commonsense reasoning, and question-answering.

• To be effective globally, these models must be aware of and account for local socio-cultural contexts, making it necessary to have benchmarks to evaluate the models for their cultural familiarity.
• Since the training data for LLMs is web-based and the Web is limited in its representation of information, it does not capture knowledge present within communities that are not on the Web.
• Thus, these models exacerbate the inequities, semantic misalignment, and stereotypes from the Web.