Bridging the Language Gap: Enhancing Multilingual Prompt-Based Code Generation in LLMs via Zero-Shot Cross-Lingual Transfer

K. Papineni, S. Roukos, T. Ward, and W.-J. Zhu, “Bleu: a method for automatic evaluation of machine translation,” in Proc. 40th Annu. Meet. Assoc. Comput. Linguistics , 2002, pp. 311–318

2002

Earlier work this paper cites.

R. Sennrich, B. Haddow, and A. Birch, “Improving neural machine translation models with monolingual data,” arXiv preprint arXiv:1511.06709, 2015

Original

2015

Earlier work this paper cites.

C. D. V. Hoang, P. Koehn, G. Haffari, and T. Cohn, “Iterative back-translation for neural machine translation,” in 2nd Workshop Neural Machine Translation and Generation , 2018, pp. 18–24

2018

Earlier work this paper cites.

M. Artetxe and H. Schwenk, “Massively multilingual sentence embeddings for zero-shot cross-lingual transfer and beyond,” Transactions of the Association for Computational Linguistics , vol. 7, pp. 597–610, 2019

2019

Earlier work this paper cites.

L. Tan and O. Golovneva, “Evaluating cross-lingual transfer learning approaches in multilingual conversational agent models,” arXiv preprint arXiv:2012.03864, 2020

Original

2020

Earlier work this paper cites.

J. Austin, A. Odena, M. Nye, M. Bosma, H. Michalewski, D. Dohan, E. Jiang, C. Cai, M. Terry, Q. Le et al. , “Program synthesis with large language models,” arXiv preprint arXiv:2108.07732, 2021

Original

2021

Earlier work this paper cites.

M. Choudhury and A. Deshpande, “How linguistically fair are multilingual pre-trained language models?” in Proc. AAAI Conf. Artificial Intelligence , vol. 35, 2021, pp. 12 710–12 718

2021

Earlier work this paper cites.

B. Zheng, L. Dong, S. Huang, W. Wang, Z. Chi, S. Singhal, W. Che, T. Liu, X. Song, and F. Wei, “Consistency regularization for cross-lingual fine-tuning,” in Proc. 59th Annu. Meet. Assoc. Comput. Linguistics , 2021, pp. 3403–3417

2021

Earlier work this paper cites.

M. Zhao and H. Schütze, “Discrete and soft prompting for multilingual models,” arXiv preprint arXiv:2109.03630, 2021

Original

2021

Earlier work this paper cites.

E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen, “Lora: low-rank adaptation of large language models,” arXiv preprint arXiv:2106.09685, 2021

Original

2021

Earlier work this paper cites.

B. Yetistiren, I. Ozsoy, and E. Tuzun, “Assessing the quality of github copilot’s code generation,” in Proc. 18th Int. Conf. Predictive Models and Data Analytics in Software Engineering , 2022, pp. 62–71

2022

Earlier work this paper cites.

Z. Talat, A. Névéol, S. Biderman, M. Clinciu, M. Dey, S. Longpre, S. Luccioni, M. Masoud, M. Mitchell, D. Radev et al. , “You reap what you sow: on the challenges of bias evaluation under multilingual settings,” in Proc. BigScience Episode #5 - Workshop on Challenges & Perspectives in Creating Large Language Models , 2022, pp. 26–41

2022

Earlier work this paper cites.

F. Shi, M. Suzgun, M. Freitag, X. Wang, S. Srivats, S. Vosoughi, H. W. Chung, Y. Tay, S. Ruder, D. Zhou et al. , “Language models are multilingual chain-of-thought reasoners,” arXiv preprint arXiv:2210.03057, 2022

Original

2022

Earlier work this paper cites.

A. Awasthi, N. Gupta, B. Samanta, S. Dave, S. Sarawagi, and P. Talukdar, “Bootstrapping multilingual semantic parsers using large language models,” arXiv preprint arXiv:2210.07313, 2022

Original

2022

Earlier work this paper cites.

C. Akiki, G. Pistilli, M. Mieskes, M. Gallé, T. Wolf, S. Ilić, and Y. Jernite, “Bigscience: a case study in the social construction of a multilingual large language model,” arXiv preprint arXiv:2212.04960, 2022

Original

2022

Earlier work this paper cites.

F. Shi, M. Suzgun, M. Freitag, X. Wang, S. Srivats, S. Vosoughi, H. W. Chung, Y. Tay, S. Ruder, D. Zhou et al. , “Language models are multilingual chain-of-thought reasoners,” arXiv preprint arXiv:2210.03057, 2022

Original

2022

Cited alongside, same era.

S. Sarsa, P. Denny, A. Hellas, and J. Leinonen, “Automatic generation of programming exercises and code explanations using large language models,” in Proc. 2022 ACM Conf. Int. Comput. Educ. Res. , 2022, pp. 27–43

2022

Cited alongside, same era.

J. Pfeiffer, N. Goyal, X. Lin, X. Li, J. Cross, S. Riedel, and M. Artetxe, “Lifting the curse of multilinguality by pre-training modular transformers,” in Proc. 2022 Conf. North American Chapter Assoc. Comput. Linguistics: Human Lang. Technol. , 2022, pp. 3479–3495

2022

Cited alongside, same era.

L. Huang, S. Ma, D. Zhang, F. Wei, and H. Wang, “Zero-shot cross-lingual transfer of prompt-based tuning with a unified multilingual prompt,” arXiv preprint arXiv:2202.11451, 2022

Original

2022

H. Huang, T. Tang, D. Zhang, W. X. Zhao, T. Song, Y. Xia, and F. Wei, “Not all languages are created equal in llms: improving multilingual capability by cross-lingual-thought prompting,” arXiv preprint arXiv:2305.07004, 2023

Original

2023

Later among the works it cites.

Y. Ma, Y. Yu, S. Li, Y. Jiang, Y. Guo, Y. Zhang, Y. Xie, and X. Liao, “Bridging code semantic and llms: semantic chain-of-thought prompting for code generation,” arXiv preprint arXiv:2310.10698, 2023

Original

2023

Later among the works it cites.

X. Li, P. Yu, C. Zhou, T. Schick, L. Zettlemoyer, O. Levy, J. Weston, and M. Lewis, “Self-alignment with instruction backtranslation,” arXiv preprint arXiv:2308.06259, 2023

Original

2023

Later among the works it cites.

Y. Chai, S. Wang, C. Pang, Y. Sun, H. Tian, and H. Wu, “ERNIE-Code: beyond english-centric cross-lingual pretraining for programming languages,” arXiv preprint arXiv:2212.06742, 2023

Original

2023

Later among the works it cites.