Localized Cultural Knowledge is Conserved and Controllable in Large Language Models

BERTScore: Evaluating text generation with BERT

Original

Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q Weinberger, and Yoav Artzi. 2020 · 1904

Earlier work this paper cites.

Thing constancy as measured by correlation coefficients

Egon Brunswik. 1940 · 1940

Earlier work this paper cites.

Culture’s consequences: International differences in work-related values , volume 5

Geert Hofstede. 1984 · 1984

Earlier work this paper cites.

Shared and separate meanings in the bilingual mental lexicon

Yanping Dong, Shichun Gui, and Brian MacWhinney. 2005 · 2005

Earlier work this paper cites.

Women, fire, and dangerous things: What categories reveal about the mind

George Lakoff. 2008 · 2008

Earlier work this paper cites.

The interpretation of cultures

Clifford Geertz. 2017 · 2017

Earlier work this paper cites.

Xnli: Evaluating cross-lingual sentence representations

Original

Alexis Conneau, Guillaume Lample, Ruty Rinott, Adina Williams, Samuel R. Bowman, Holger Schwenk, and Veselin Stoyanov. 2018 · 2018

Earlier work this paper cites.

Cross-lingual language model pretraining

Alexis Conneau and Guillaume Lample. 2019 · 2019

Earlier work this paper cites.

Parameter-efficient transfer learning for nlp

Neil Houlsby, Andrei Giurgiu, Stanislaw Jastrzebski, Bruna Morrone, Quentin De Laroussilhe, Andrea Gesmundo, Mona Attariyan, and Sylvain Gelly. 2019 · 2019

Earlier work this paper cites.

XCOPA: A multilingual dataset for causal commonsense reasoning

Edoardo Maria Ponti, Goran Glavaš, Olga Majewska, Qianchu Liu, Ivan Vulić, and Anna Korhonen. 2020 · 2020

Earlier work this paper cites.

Investigating gender bias in language models using causal mediation analysis

Jesse Vig, Sebastian Gehrmann, Yonatan Belinkov, Sharon Qian, Daniel Nevo, Yaron Singer, and Stuart Shieber. 2020 · 2020

Earlier work this paper cites.

World values survey: Round seven–country-pooled datafile

Christian Haerpfer, Ronald Inglehart, Alejandro Moreno, Christian Welzel, Kseniya Kizilova, Jaime Diez-Medrano, Marta Lagos, Pippa Norris, Eduard Ponarin, Björn Puranen, et al. 2020 · 2021

Earlier work this paper cites.

LoRA: Low-rank adaptation of large language models

Original

Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021 · 2021

Earlier work this paper cites.

Multilingual LAMA: Investigating knowledge in multilingual pretrained language models

Original

Nora Kassner, Philipp Dufter, and Hinrich Schütze. 2021 · 2021

Earlier work this paper cites.

Prefix-tuning: Optimizing continuous prompts for generation

Original

Xiang Lisa Li and Percy Liang. 2021 · 2021

Earlier work this paper cites.

Common sense beyond English: Evaluating and improving multilingual language models for commonsense reasoning

Bill Yuchen Lin, Seyeon Lee, Xiaoyang Qiao, and Xiang Ren. 2021 · 2021

Earlier work this paper cites.

Understanding semantic accents in Japanese–English bilinguals: A feature-based approach

Eriko Matsuki, Yasushi Hino, and Debra Jared. 2021 · 2021

Earlier work this paper cites.

How well can text-to-image generative models understand ethical natural language interventions?

Original

Hritik Bansal, Da Yin, Masoud Monajatipoor, and Kai-Wei Chang. 2022 · 2022

Earlier work this paper cites.

Shapley head pruning: Identifying and removing interference in multilingual transformers

Original

William Held and Diyi Yang. 2022 · 2022

Earlier work this paper cites.

Language models are multilingual chain-of-thought reasoners

Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, Dipanjan Das, and Jason Wei. 2022 · 2022

Earlier work this paper cites.

Geomlama: Geo-diverse commonsense probing on multilingual pre-trained language models

Original

Da Yin, Hritik Bansal, Masoud Monajatipoor, Liunian Harold Li, and Kai-Wei Chang. 2022 · 2022

Earlier work this paper cites.

Prix-LM: Pretraining for multilingual knowledge base construction

Wenxuan Zhou, Fangyu Liu, Ivan Vulić, Nigel Collier, and Muhao Chen. 2022 · 2022

Earlier work this paper cites.

Probing pre-trained language models for cross-cultural differences in values

Arnav Arora, Lucie-aimée Kaffee, and Isabelle Augenstein. 2023 · 2023

Earlier work this paper cites.

When is multilinguality a curse? language modeling for 250 high- and low-resource languages

Tyler A. Chang, Catherine Arnett, Zhuowen Tu, and Benjamin Bergen. 2023 · 2023

Earlier work this paper cites.

Okapi: Instruction-tuned large language models in multiple languages with reinforcement learning from human feedback

Original

Viet Dac Lai, Chien Van Nguyen, Nghia Trung Ngo, Thuat Nguyen, Franck Dernoncourt, Ryan A Rossi, and Thien Huu Nguyen. 2023 · 2023

Earlier work this paper cites.

Qlora: Efficient finetuning of quantized llms

Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, and Luke Zettlemoyer. 2023 · 2023

Earlier work this paper cites.

Local similarity and global variability characterize the semantic space of human languages

Molly Lewis, Aoife Cahill, Nitin Madnani, and James Evans. 2023 · 2023

Earlier work this paper cites.

Locating and editing factual associations in GPT

Original

Kevin Meng, David Bau, Alex Andonian, and Yonatan Belinkov. 2023 · 2023

Earlier work this paper cites.

Crosslingual generalization through multitask finetuning

Original

Niklas Muennighoff, Thomas Wang, Lintang Sutawika, Adam Roberts, Stella Biderman, Teven Le Scao, M Saiful Bari, Sheng Shen, Zheng-Xin Yong, Hailey Schoelkopf, et al. 2023 · 2023

Cited alongside, same era.

Finland’s chatgpt equivalent begins to think in estonian as well

Rait Piir. 2023 · 2023

Cited alongside, same era.

Cross-lingual consistency of factual knowledge in multilingual language models

Jirui Qi, Raquel Fernández, and Arianna Bisazza. 2023 · 2023

Cited alongside, same era.

Look before you leap: A universal emergent decomposition of retrieval tasks in language models

Original

Alexandre Variengien and Eric Winsor. 2023 · 2023

Cited alongside, same era.

Don’t trust ChatGPT when your question is not in english: A study of multilingual abilities and types of LLMs

Original

Analyzing the evaluation of cross-lingual knowledge transfer in multilingual language models

Original

Sara Rajaee and Christof Monz. 2024 · 2024

Later among the works it cites.

Include: Evaluating multilingual language understanding with regional knowledge

Original

Angelika Romanou, Negar Foroutan, Anna Sotnikova, Zeming Chen, Sree Harsha Nelaturu, Shivalika Singh, Rishabh Maheshwary, Micol Altomare, Mohamed A Haggag, Alfonso Amayuelas, et al. 2024 · 2024

Later among the works it cites.

The role of language imbalance in cross-lingual generalisation: Insights from cloned language experiments

Original

Anton Schäfer, Shauli Ravfogel, Thomas Hofmann, Tiago Pimentel, and Imanol Schlag. 2024 · 2024

Later among the works it cites.

Aya dataset: An open-access collection for multilingual instruction tuning

Shivalika Singh, Freddie Vargus, Daniel Dsouza, Börje F. Karlsson, Abinaya Mahendiran, Wei-Yin Ko, Herumb Shandilya, Jay Patel, Deividas Mataciunas, Laura OMahony, Mike Zhang, Ramith Hettiarachchi, Joseph Wilson, Marina Machado, Luisa Souza Moura, Dominik Krzemi’nski, Hakimeh Fadaei, Irem Ergun, Ifeoma Okoh, Aisha Alaagib, Oshan Mudannayake, Zaid Alyafeai, Minh Chien Vu, Sebastian Ruder, Surya Guthikonda, Emad A. Alghamdi, Sebastian Gehrmann, Niklas Muennighoff, Max Bartolo, Julia Kreutzer, A. Ustun, Marzieh Fadaee, and Sara Hooker. 2024 · 2024