"A Woman is More Culturally Knowledgeable than A Man?": The Effect of Personas on Cultural Norm Interpretation in LLMs

A new measure of rank correlation

M. G. Kendall. 1938 · 1938

Earlier work this paper cites.

Probing pre-trained language models for cross-cultural differences in values

Original

Arnav Arora, Lucie-Aimée Kaffee, and Isabelle Augenstein. 2022 · 2022

Earlier work this paper cites.

Gpt-4 technical report

Original

Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2023 · 2023

Earlier work this paper cites.

Toxicity in chatgpt: Analyzing persona-assigned language models

Ameet Deshpande, Vishvak Murahari, Tanmay Rajpurohit, Ashwin Kalyan, and Karthik Narasimhan. 2023 · 2023

Earlier work this paper cites.

Eticor: Corpus for analyzing llms for etiquettes

Ashutosh Dwivedi, Pradhyumna Lavania, and Ashutosh Modi. 2023 · 2023

Earlier work this paper cites.

Bias runs deep: Implicit reasoning biases in persona-assigned llms

Original

Shashank Gupta, Vaishnavi Shrivastava, Ameet Deshpande, Ashwin Kalyan, Peter Clark, Ashish Sabharwal, and Tushar Khot. 2023 · 2023

Earlier work this paper cites.

Mistral 7b

Original

Albert Q Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, et al. 2023 · 2023

Earlier work this paper cites.

Fork: A bite-sized test set for probing culinary cultural biases in commonsense reasoning models

Shramay Palta and Rachel Rudinger. 2023 · 2023

Earlier work this paper cites.

Knowledge of cultural moral norms in large language models

Original

Aida Ramezani and Yang Xu. 2023 · 2023

Earlier work this paper cites.

Llama 2: Open foundation and fine-tuned chat models

Original

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. 2023 · 2023

Cited alongside, same era.

Not all countries celebrate thanksgiving: On the cultural dominance in large language models

Original

Wenxuan Wang, Wenxiang Jiao, Jingyuan Huang, Ruyi Dai, Jen-tse Huang, Zhaopeng Tu, and Michael R Lyu. 2023 · 2023

Cited alongside, same era.

Towards measuring and modeling" culture" in llms: A survey

Original

Muhammad Farid Adilazuarda, Sagnik Mukherjee, Pradhyumna Lavania, Siddhant Singh, Ashutosh Dwivedi, Alham Fikri Aji, Jacki O’Neill, Ashutosh Modi, and Monojit Choudhury. 2024 · 2024

Cited alongside, same era.

Sensitivity, performance, robustness: Deconstructing the effect of sociodemographic prompting

Tilman Beck, Hendrik Schuff, Anne Lauscher, and Iryna Gurevych. 2024 · 2024

Cited alongside, same era.

Culture-gen: Revealing global cultural perception in language models through natural language prompting

Original

Huihan Li, Liwei Jiang, Nouha Dziri, Xiang Ren, and Yejin Choi. 2024 · 2024

Closest in time.

Culturally aware and adapted nlp: A taxonomy and a survey of the state of the art

Original

Chen Cecilia Liu, Iryna Gurevych, and Anna Korhonen. 2024 · 2024

Closest in time.

Cultural conditioning or placebo? on the effectiveness of socio-demographic prompting

Original

Sagnik Mukherjee, Muhammad Farid Adilazuarda, Sunayana Sitaram, Kalika Bali, Alham Fikri Aji, and Monojit Choudhury. 2024 · 2024

Closest in time.

Angry men, sad women: Large language models reflect gendered stereotypes in emotion attribution

Original

Flor Miriam Plaza-del Arco, Amanda Cercas Curry, Alba Curry, Gavin Abercrombie, and Dirk Hovy. 2024 · 2024

Closest in time.