Fetching the paper…
Reading the bibliography…
This paper introduces the "CIVICS: Culturally-Informed & Values-Inclusive Corpus for Societal impacts" dataset, designed to evaluate the social and cultural variation of Large Language Models (LLMs) across multiple languages and value-sensitive topics.
A technique for the measurement of attitudes
Likert, R. 1932 · 1932
Earlier work this paper cites.
Large language models in medicine
Thirunavukarasu, A. J.; Ting, D. S. J.; Elangovan, K.; Gutierrez, L.; Tan, T. F.; and Ting, D. S. W. 2023 · 1940
Earlier work this paper cites.
The Universal Declaration of Human Rights (UDHR)
United Nations General Assembly. 1948 · 1948
Earlier work this paper cites.
International Covenant on Civil and Political Rights
UN General Assembly. 1966 · 1966
Earlier work this paper cites.
The problem of abortion and the doctrine of double effect , volume 5
Foot, P. 1967 · 1967
Earlier work this paper cites.
Language as a Core Value of Culture
Smolicz, J. 1980 · 1980
Earlier work this paper cites.
Convention on the Rights of the Child
United Nations. 1989 · 1989
Earlier work this paper cites.
Document Title
Council of Europe. 1994 · 1994
Earlier work this paper cites.
Culture’s recent consequences: Using dimension scores in theory and research
Hofstede, G. 2001 · 2001
Earlier work this paper cites.
International Standards Governing Migration Policy
Office of the United Nations High Commissioner for Human Rights. 2004 · 2004
Earlier work this paper cites.
Convention on the Rights of Persons with Disabilities
United Nations. 2006 · 2006
Earlier work this paper cites.
Yogyakarta Principles: Principles on the application of international human rights law in relation to sexual orientation and gender identity
International Commission of Jurists. 2007 · 2007
Earlier work this paper cites.
Aligning ai with shared human values
Hendrycks, D.; Burns, C.; Basart, S.; Critch, A.; Li, J.; Song, D.; and Steinhardt, J. 2020 · 2008
Earlier work this paper cites.
ILO Declaration on Social Justice for a Fair Globalization
International Labour Organization. 2008 · 2008
Earlier work this paper cites.
Values, Cultural Identity and Communication: A Perspective From Philosophy of Language
Nordby, H. 2008 · 2008
Earlier work this paper cites.
Measuring Massive Multitask Language Understanding
Hendrycks, D.; Burns, C.; Basart, S.; Zou, A.; Mazeika, M.; Song, D.; and Steinhardt, J. 2021 · 2009
Earlier work this paper cites.
Using likert-type scales in the social sciences
Croasmun, J. T.; and Ostrom, L. 2011 · 2011
Earlier work this paper cites.
Your morals depend on language
Costa, A.; Foucart, A.; Hayakawa, S.; Aparici, M.; Apesteguia, J.; Heafner, J.; and Keysar, B. 2014 · 2014
Earlier work this paper cites.
Sexual health, human rights and the law
World Health Organization. 2015 · 2015
Earlier work this paper cites.
Another look at Likert scales
Willits, F. K.; Theodori, G. L.; and Luloff, A. 2016 · 2016
Earlier work this paper cites.
Human Rights Aspects of Immigrant and Refugee Integration Policies
Council of Europe. 2019 · 2019
Earlier work this paper cites.
2020 Exploratory Testing Survey
ANES. 2020 · 2020
Earlier work this paper cites.
Social Chemistry 101: Learning to Reason about Social and Moral Norms
Forbes, M.; Hwang, J. D.; Shwartz, V.; Sap, M.; and Choi, Y. 2020 · 2020
Earlier work this paper cites.
Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequences
Emelin, D.; Le Bras, R.; Hwang, J. D.; Forbes, M.; and Choi, Y. 2021 · 2021
Earlier work this paper cites.
Press Release: Commission welcomes provisional agreement on the Asylum and Migration Management Regulation
European Commission. 2021 · 2021
Earlier work this paper cites.
The Political Compass Test
Political Compass. 2021 · 2021
Earlier work this paper cites.
Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detection
Vidgen, B.; Thrush, T.; Waseem, Z.; and Kiela, D. 2021 · 2021
Cited alongside, same era.
World values survey: Round seven-country-pooled datafile version 5.0
Haerpfer, C.; Inglehart, R.; Moreno, A.; Welzel, C.; Kizilova, K.; Diez-Medrano, J.; Lagos, M.; Norris, P.; Ponarin, E.; Puranen, B.; et al. 2022 · 2022
Cited alongside, same era.
Challenges and strategies in cross-cultural NLP
Hershcovich, D.; Frank, S.; Lent, H.; de Lhoneux, M.; Abdou, M.; Brandl, S.; Bugliarello, E.; Piqueras, L. C.; Chalkidis, I.; Cui, R.; et al. 2022 · 2022
Cited alongside, same era.
CommunityLM: Probing Partisan Worldviews from Language Models
Jiang, H.; Beeferman, D.; Roy, B.; and Roy, D. 2022 · 2022
Cited alongside, same era.
The Ghost in the Machine has an American accent: value conflict in GPT-3
Johnson, R. L.; Pistilli, G.; Menédez-González, N.; Duran, L. D. D.; Panai, E.; Kalpokiene, J.; and Bertulfo, D. J. 2022 · 2022
NLPositionality: Characterizing Design Biases of Datasets and Models
Santy, S.; Liang, J. T.; Bras, R. L.; Reinecke, K.; and Sap, M. 2023 · 2023
Later among the works it cites.
Moral Mimicry: Large Language Models Produce Moral Rationalizations Tailored to Political Identity
Simmons, G. 2023 · 2023
Later among the works it cites.
Large language models for enhancing customer lifecycle management
Soni, V. 2023 · 2023
Later among the works it cites.
Evaluating large language models on medical evidence summarization
Tang, L.; Sun, Z.; Idnay, B.; Nestor, J. G.; Soroush, A.; Elias, P. A.; Xu, Z.; Ding, Y.; Durrett, G.; Rousseau, J. F.; et al. 2023 · 2023
Later among the works it cites.
Auditing and Mitigating Cultural Bias in LLMs
Tao, Y.; Viberg, O.; Baker, R. S.; and Kizilcec, R. F. 2023 · 2023
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Red Teaming Language Models with Language Models
Perez, E.; Huang, S.; Song, F.; Cai, T.; Ring, R.; Aslanides, J.; Glaese, A.; McAleese, N.; and Irving, G. 2022 · 2022
Cited alongside, same era.
Cultural Incongruencies in Artificial Intelligence
Prabhakaran, V.; Qadri, R.; and Hutchinson, B. 2022 · 2022
Cited alongside, same era.
Do Prompt-Based Models Really Understand the Meaning of Their Prompts?
Webson, A.; and Pavlick, E. 2022 · 2022
Cited alongside, same era.
Probing Pre-Trained Language Models for Cross-Cultural Differences in Values
Arora, A.; Kaffee, L.-A.; and Augenstein, I. 2023 · 2023
Cited alongside, same era.
Which humans?
Atari, M.; Xue, M. J.; Park, P. S.; Blasi, D.; and Henrich, J. 2023 · 2023
Cited alongside, same era.
Bai, J.; Bai, S.; Chu, Y.; Cui, Z.; Dang, K.; Deng, X.; Fan, Y.; Ge, W.; Han, Y.; Huang, F.; Hui, B.; Ji, L.; Li, M.; Lin, J.; Lin, R.; Liu, D.; Liu, G.; Lu, C.; Lu, K.; Ma, J.; Men, R.; Ren, X.; Ren, X.; Tan, C.; Tan, S.; Tu, J.; Wang, P.; Wang, S.; Wang, W.; Wu, S.; Xu, B.; Xu, J.; Yang, A.; Yang, H.; Yang, J.; Yang, S.; Yao, Y.; Yu, B.; Yuan, H.; Yuan, Z.; Zhang, J.; Zhang, X.; Zhang, Y.; Zhang, Z.; Zhou, C.; Zhou, J.; Zhou, X.; and Zhu, T. 2023 · 2023
Cited alongside, same era.
Leveraging large language models for decision support in personalized oncology
Benary, M.; Wang, X. D.; Schmidt, M.; Soll, D.; Hilfenhaus, G.; Nassir, M.; Sigler, C.; Knödler, M.; Keller, U.; Beule, D.; et al. 2023 · 2023
Cited alongside, same era.
Later among the works it cites.
SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning
Wang, B.; Liu, Z.; Huang, X.; Jiao, F.; Ding, Y.; Aw, A. T.; and Chen, N. F. 2023 · 2023
Later among the works it cites.
Cvalues: Measuring the values of chinese large language models from safety to responsibility
Xu, G.; Liu, J.; Yan, M.; Xu, H.; Si, J.; Zhou, Z.; Yi, P.; Gao, X.; Sang, J.; Zhang, R.; et al. 2023 · 2023
Later among the works it cites.
Yi: Open Foundation Models by 01.AI
01. AI: Young, A.; Chen, B.; Li, C.; Huang, C.; Zhang, G.; Zhang, G.; Li, H.; Zhu, J.; Chen, J.; Chang, J.; Yu, K.; Liu, P.; Liu, Q.; Yue, S.; Yang, S.; Yang, S.; Yu, T.; Xie, W.; Huang, W.; Hu, X.; Ren, X.; Niu, X.; Nie, P.; Xu, Y.; Liu, Y.; Wang, Y.; Cai, Y.; Gu, Z.; Liu, Z.; and Dai, Z. 2024 · 2024
Closest in time.
Llama 3 Model Card
AI@Meta. 2024 · 2024
Closest in time.
Massively multi-cultural knowledge acquisition & lm benchmarking
Fung, Y.; Zhao, R.; Doo, J.; Sun, C.; and Ji, H. 2024 · 2024
Closest in time.
Gemma: Open models based on gemini research and technology
Gemma Team: Mesnard, T.; Hardin, C.; Dadashi, R.; Bhupatiraju, S.; Pathak, S.; Sifre, L.; Rivière, M.; Kale, M. S.; Love, J.; et al. 2024 · 2024
Closest in time.
Assessing the Alignment of Large Language Models With Human Values for Mental Health Integration: Cross-Sectional Study Using Schwartz’s Theory of Basic Values
Hadar-Shoval, D.; Asraf, K.; Mizrachi, Y.; Haber, Y.; and Elyoseph, Z. 2024 · 2024
Closest in time.
Legislative Projects: Parentage / Surrogacy
Hague Conference on Private International Law. 2024 · 2024
Closest in time.
Kirk, H. R.; Whitefield, A.; Röttger, P.; Bean, A.; Margatina, K.; Ciro, J.; Mosquera, R.; Bartolo, M.; Williams, A.; He, H.; et al. 2024 · 2024
Closest in time.
Openassistant conversations-democratizing large language model alignment
Köpf, A.; Kilcher, Y.; von Rütte, D.; Anagnostidis, S.; Tam, Z. R.; Stevens, K.; Barhoum, A.; Nguyen, D.; Stanley, O.; Nagyfi, R.; et al. 2024 · 2024
Closest in time.
KorNAT: LLM Alignment Benchmark for Korean Social Values and Common Knowledge
Lee, J.; Kim, M.; Kim, S.; Kim, J.; Won, S.; Lee, H.; and Choi, E. 2024 · 2024
Closest in time.
Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models’ Alignment
Liu, Y.; Yao, Y.; Ton, J.-F.; Zhang, X.; Guo, R.; Cheng, H.; Klochkov, Y.; Taufiq, M. F.; and Li, H. 2024 · 2024
Closest in time.
MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment Tasks
Nie, A.; Zhang, Y.; Amdekar, A. S.; Piech, C.; Hashimoto, T. B.; and Gerstenberg, T. 2024 · 2024
Closest in time.
NORMAD: A Benchmark for Measuring the Cultural Adaptability of Large Language Models
Rao, A.; Yerukola, A.; Shah, V.; Reinecke, K.; and Sap, M. 2024 · 2024
Closest in time.
Röttger, P.; Hofmann, V.; Pyatkin, V.; Hinck, M.; Kirk, H. R.; Schütze, H.; and Hovy, D. 2024 · 2024
Closest in time.
Evaluating the moral beliefs encoded in llms
Scherrer, N.; Shi, C.; Feder, A.; and Blei, D. 2024 · 2024
Closest in time.
Value kaleidoscope: Engaging ai with pluralistic human values, rights, and duties
Sorensen, T.; Jiang, L.; Hwang, J. D.; Levine, S.; Pyatkin, V.; West, P.; Dziri, N.; Lu, X.; Rao, K.; Bhagavatula, C.; et al. 2024 · 2024
Closest in time.
Elon Musk’s X to Summarize News Events Using Grok.AI
Wagner, K. 2024 · 2024
Closest in time.
Task supportive and personalized human-large language model interaction: A user study
Wang, B.; et al. 2024 · 2024
Closest in time.
Benchmarking large language models for news summarization
Zhang, T.; Ladhak, F.; Durmus, E.; Liang, P.; McKeown, K.; and Hashimoto, T. B. 2024 · 2024
Closest in time.