Can LLMs Grasp Implicit Cultural Values? Benchmarking LLMs' Cultural Intelligence with CQ-Bench

Cultural intelligence: Individual interactions across cultures

P Christopher Earley and Soon Ang. 2003 · 2003

Earlier work this paper cites.

Are cultural values the same as the values of individuals? an examination of similarities in personal, social and cultural value structures

Ronald Fischer and Ype H Poortinga. 2012 · 2012

Earlier work this paper cites.

A diversity-promoting objective function for neural conversation models

Original

Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, and Bill Dolan. 2016 · 2016

Earlier work this paper cites.

Lora: Low-rank adaptation of large language models

Original

Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021 · 2021

Earlier work this paper cites.

Augmented SBERT: Data augmentation method for improving bi-encoders for pairwise sentence scoring tasks

Nandan Thakur, Nils Reimers, Johannes Daxenberger, and Iryna Gurevych. 2021 · 2021

Earlier work this paper cites.

Normsage: Multi-lingual multi-cultural norm discovery from conversations on-the-fly

Original

Yi R Fung, Tuhin Chakraborty, Hao Guo, Owen Rambow, Smaranda Muresan, and Heng Ji. 2022 · 2022

Earlier work this paper cites.

World values survey wave 7 (2017-2022) cross-national data-set

Christian Haerpfer, Ronald Inglehart, Alejandro Moreno, Christian Welzel, Kseniya Kizilova, Jaime Diez-Medrano, Marta Lagos, Pippa Norris, Eduard Ponarin, and Bi Puranen. 2022 · 2022

Earlier work this paper cites.

The Ghost in the Machine has an American accent: value conflict in GPT-3

Original

Rebecca L. Johnson, Giada Pistilli, Natalia Menédez-González, Leslye Denisse Dias Duran, Enrico Panai, Julija Kalpokiene, and Donald Jay Bertulfo. 2022 · 2022

Earlier work this paper cites.

Persianllama: Towards building first persian large language model

Original

Mohammad Amin Abbasi, Arash Ghafouri, Mahdi Firouzmandi, Hassan Naderi, and Behrouz Minaei Bidgoli. 2023 · 2023

Earlier work this paper cites.

Qwen technical report

Original

Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, Binyuan Hui, Luo Ji, Mei Li, Junyang Lin, Runji Lin, Dayiheng Liu, Gao Liu, Chengqiang Lu, Keming Lu, and 29 others. 2023 · 2023

Earlier work this paper cites.

Towards measuring the representation of subjective global opinions in language models

Original

Esin Durmus, Karina Nyugen, Thomas I. Liao, Nicholas Schiefer, Amanda Askell, Anton Bakhtin, Carol Chen, Zac Hatfield-Dodds, Danny Hernandez, Nicholas Joseph, Liane Lovitt, Sam McCandlish, Orowa Sikder, Alex Tamkin, Janel Thamkul, Jared Kaplan, Jack Clark, and Deep Ganguli. 2023 · 2023

Earlier work this paper cites.

Semeval-2023 task 4: Valueeval: Identification of human values behind arguments

Johannes Kiesel, Milad Alshomary, Nailia Mirzakhmedova, Maximilian Heinrich, Nicolas Handke, Henning Wachsmuth, and Benno Stein. 2023 · 2023

Earlier work this paper cites.

Normdial: A comparable bilingual synthetic dialog dataset for modeling social norm adherence and violation

Original

Aochong Li, Mallika Subramanian, Arkadiy Saakyan, Sky CH-Wang, and S. Muresan. 2023 · 2023

Earlier work this paper cites.

Taiwan llm: Bridging the linguistic divide with a culturally aligned language model

Original

Yen-Ting Lin and Yun-Nung Chen. 2023 · 2023

Earlier work this paper cites.

Seallms–large language models for southeast asia

Original

Xuan-Phi Nguyen, Wenxuan Zhang, Xin Li, Mahani Aljunied, Zhiqiang Hu, Chenhui Shen, Yew Ken Chia, Xingxuan Li, Jianyu Wang, Qingyu Tan, and 1 others. 2023 · 2023

Earlier work this paper cites.

Judging llm-as-a-judge with mt-bench and chatbot arena

Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric Xing, and 1 others. 2023 · 2023

Cited alongside, same era.

On Cultural Intelligence in LLM-Based Chatbots: Implications for Artificial Intelligence in Education

Emmanuel G. Blanchard and Phaedra Mohammed. 2024 · 2024

Cited alongside, same era.

Enhancing llm-based human-robot interaction with nuances for diversity awareness

Lucrezia Grassi, Carmine Tommaso Recchiuto, and Antonio Sgorbissa. 2024 · 2024

Cited alongside, same era.

The llama 3 herd of models

Original

Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Alex Vaughan, and 1 others. 2024 · 2024

Cited alongside, same era.

On the humanity of conversational ai: Evaluating the psychological portrayal of llms

Jen-tse Huang, Wenxuan Wang, Eric John Li, Man Ho Lam, Shujie Ren, Youliang Yuan, Wenxiang Jiao, Zhaopeng Tu, and Michael Lyu. 2024 · 2024

Not all countries celebrate thanksgiving: On the cultural dominance in large language models

Wenxuan Wang, Wenxiang Jiao, Jingyuan Huang, Ruyi Dai, Jen-tse Huang, Zhaopeng Tu, and Michael Lyu. 2024 · 2024

Later among the works it cites.

CLAVE: An Adaptive Framework for Evaluating Values of LLM Generated Responses

Original

Jing Yao, Xiaoyuan Yi, and Xing Xie. 2024 · 2024

Later among the works it cites.

ValueDCG: Measuring Comprehensive Human Value Understanding Ability of Language Models

Original

Zhaowei Zhang, Fengshuo Bai, Jun Gao, and Yaodong Yang. 2024 · 2024

Later among the works it cites.

Llamafactory: Unified efficient fine-tuning of 100+ language models

Original

Yaowei Zheng, Richong Zhang, Junhao Zhang, Yanhan Ye, Zheyan Luo, Zhangchi Feng, and Yongqiang Ma. 2024 · 2024

Later among the works it cites.

Cultural Value Differences of LLMs: Prompt, Language, and Model Size