M2Lingual: Enhancing Multilingual, Multi-Turn Instruction Alignment in Large Language Models

K. Papineni, S. Roukos, T. Ward, and W.-J. Zhu, “Bleu: a method for automatic evaluation of machine translation,” in Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics , P. Isabelle, E. Charniak, and D. Lin, Eds. Philadelphia, Pennsylvania, USA: Association for Computational Linguistics, Jul. 2002, pp. 311–318. [Online]. Available: https://aclanthology.org/P02-1040

2002

Earlier work this paper cites.

C.-Y. Lin, “ROUGE: A package for automatic evaluation of summaries,” in Text Summarization Branches Out . Barcelona, Spain: Association for Computational Linguistics, Jul. 2004, pp. 74–81. [Online]. Available: https://aclanthology.org/W04-1013

2004

Earlier work this paper cites.

D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980 , 2014

Original

2014

Earlier work this paper cites.

A. Conneau, G. Lample, R. Rinott, A. Williams, S. R. Bowman, H. Schwenk, and V. Stoyanov, “Xnli: Evaluating cross-lingual sentence representations,” arXiv preprint arXiv:1809.05053 , 2018

Original

2018

Earlier work this paper cites.

N. C. Abay, Y. Zhou, M. Kantarcioglu, B. Thuraisingham, and L. Sweeney, “Privacy preserving synthetic data release using deep learning,” in Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2018, Dublin, Ireland, September 10–14, 2018, Proceedings, Part I 18 . Springer, 2019, pp. 510–526

2019

Earlier work this paper cites.

M. Przystupa and M. Abdul-Mageed, “Neural machine translation of low-resource and similar languages with backtranslation,” in Proceedings of the Fourth Conference on Machine Translation (Volume 3: Shared Task Papers, Day 2) , 2019, pp. 224–235

2019

Earlier work this paper cites.

M. Artetxe, S. Ruder, and D. Yogatama, “On the cross-lingual transferability of monolingual representations,” arXiv preprint arXiv:1910.11856 , 2019

Original

2019

Earlier work this paper cites.

P. Lewis, B. Oğuz, R. Rinott, S. Riedel, and H. Schwenk, “Mlqa: Evaluating cross-lingual extractive question answering,” arXiv preprint arXiv:1910.07475 , 2019

Original

2019

Earlier work this paper cites.

Y. Bizzoni, T. S. Juzek, C. España-Bonet, K. D. Chowdhury, J. van Genabith, and E. Teich, “How human is machine translationese? comparing human and machine translations of text and speech,” in Proceedings of the 17th International conference on spoken language translation , 2020, pp. 280–290

2020

Earlier work this paper cites.

J. H. Clark, E. Choi, M. Collins, D. Garrette, T. Kwiatkowski, V. Nikolaev, and J. Palomaki, “Tydi qa: A benchmark for information-seeking question answering in ty pologically di verse languages,” Transactions of the Association for Computational Linguistics , vol. 8, pp. 454–470, 2020

2020

Earlier work this paper cites.

E. M. Ponti, G. Glavaš, O. Majewska, Q. Liu, I. Vulić, and A. Korhonen, “Xcopa: A multilingual dataset for causal commonsense reasoning,” arXiv preprint arXiv:2005.00333 , 2020

Original

2020

Earlier work this paper cites.

E. Vanmassenhove, D. Shterionov, and M. Gwilliam, “Machine translationese: Effects of algorithmic bias on linguistic complexity in machine translation,” arXiv preprint arXiv:2102.00287 , 2021

Original

2021

Earlier work this paper cites.

V. Sanh, A. Webson, C. Raffel, S. Bach, L. Sutawika, Z. Alyafeai, A. Chaffin, A. Stiegler, A. Raja, M. Dey et al. , “Multitask prompted training enables zero-shot task generalization,” in International Conference on Learning Representations , 2021

2021

Earlier work this paper cites.

Z. Zhang and H. Zhao, “Advances in multi-turn dialogue comprehension: A survey,” arXiv preprint arXiv:2103.03125 , 2021

Original

2021

Earlier work this paper cites.

H. Guo, B. Tan, Z. Liu, E. P. Xing, and Z. Hu, “Efficient (soft) q-learning for text generation with limited good data,” arXiv preprint arXiv:2106.07704 , 2021

Original

2021

Earlier work this paper cites.

L. Gao, J. Tow, S. Biderman, S. Black, A. DiPofi, C. Foster, L. Golding, J. Hsu, K. McDonell, N. Muennighoff, J. Phang, L. Reynolds, E. Tang, A. Thite, B. Wang, K. Wang, and A. Zou, “A framework for few-shot language model evaluation,” Sep. 2021. [Online]. Available: https://doi.org/10.5281/zenodo.5371628

2021

Earlier work this paper cites.

T. Hasan, A. Bhattacharjee, M. S. Islam, K. Samin, Y.-F. Li, Y.-B. Kang, M. S. Rahman, and R. Shahriyar, “Xl-sum: Large-scale multilingual abstractive summarization for 44 languages,” arXiv preprint arXiv:2106.13822 , 2021

Original

2021

Earlier work this paper cites.

K. Cobbe, V. Kosaraju, M. Bavarian, M. Chen, H. Jun, L. Kaiser, M. Plappert, J. Tworek, J. Hilton, R. Nakano et al. , “Training verifiers to solve math word problems,” arXiv preprint arXiv:2110.14168 , 2021

Original

2021

Earlier work this paper cites.

J. Choquette, W. Gandhi, O. Giroux, N. Stam, and R. Krashinsky, “Nvidia a100 tensor core gpu: Performance and innovation,” IEEE Micro , vol. 41, no. 02, pp. 29–35, 2021

2021

Earlier work this paper cites.

M. R. Costa-jussà, J. Cross, O. Çelebi, M. Elbayad, K. Heafield, K. Heffernan, E. Kalbassi, J. Lam, D. Licht, J. Maillard et al. , “No language left behind: Scaling human-centered machine translation,” arXiv preprint arXiv:2207.04672 , 2022

Original

2022

Cited alongside, same era.

Y. Wang, S. Mishra, P. Alipoormolabashi, Y. Kordi, A. Mirzaei, A. Naik, A. Ashok, A. S. Dhanasekaran, A. Arunkumar, D. Stap et al. , “Super-naturalinstructions: Generalization via declarative instructions on 1600+ nlp tasks,” in Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing , 2022, pp. 5085–5109

2022

Cited alongside, same era.

F. Shi, M. Suzgun, M. Freitag, X. Wang, S. Srivats, S. Vosoughi, H. W. Chung, Y. Tay, S. Ruder, D. Zhou et al. , “Language models are multilingual chain-of-thought reasoners,” arXiv preprint arXiv:2210.03057 , 2022

Original

2022

Cited alongside, same era.

N. Goyal, C. Gao, V. Chaudhary, P.-J. Chen, G. Wenzek, D. Ju, S. Krishnan, M. Ranzato, F. Guzmán, and A. Fan, “The flores-101 evaluation benchmark for low-resource and multilingual machine translation,” Transactions of the Association for Computational Linguistics , vol. 10, pp. 522–538, 2022

Y. Wang, Y. Kordi, S. Mishra, A. Liu, N. A. Smith, D. Khashabi, and H. Hajishirzi, “Self-instruct: Aligning language models with self-generated instructions,” in Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , 2023, pp. 13 484–13 508

2023

Later among the works it cites.

L. Chen, S. Li, J. Yan, H. Wang, K. Gunaratna, V. Yadav, Z. Tang, V. Srinivasan, T. Zhou, H. Huang et al. , “Alpagasus: Training a better alpaca with fewer data,” arXiv preprint arXiv:2307.08701 , 2023

Original

2023

Later among the works it cites.

A. Elmadany, E. M. B. Nagoudi, and M. Abdul-Mageed, “Octopus: A multitask model and toolkit for arabic natural language generation,” arXiv preprint arXiv:2310.16127 , 2023

Original

2023

Later among the works it cites.

A. Q. Jiang, A. Sablayrolles, A. Mensch, C. Bamford, D. S. Chaplot, D. d. l. Casas, F. Bressand, G. Lengyel, G. Lample, L. Saulnier et al. , “Mistral 7b,” arXiv preprint arXiv:2310.06825 , 2023

Original