Efficient and Effective Vocabulary Expansion Towards Multilingual Large Language Models

Choice of plausible alternatives: An evaluation of commonsense causal reasoning

Melissa Roemmele, Cosmin Adrian Bejan, and Andrew S Gordon. 2011 · 2011

Earlier work this paper cites.

Decoupled weight decay regularization

Ilya Loshchilov and Frank Hutter. 2018 · 2018

Earlier work this paper cites.

Boolq: Exploring the surprising difficulty of natural yes/no questions

Christopher Clark, Kenton Lee, Ming-Wei Chang, Tom Kwiatkowski, Michael Collins, and Kristina Toutanova. 2019 · 2019

Earlier work this paper cites.

Wic: the word-in-context dataset for evaluating context-sensitive meaning representations

Mohammad Taher Pilehvar and Jose Camacho-Collados. 2019 · 2019

Earlier work this paper cites.

Hellaswag: Can a machine really finish your sentence?

Rowan Zellers, Ari Holtzman, Yonatan Bisk, Ali Farhadi, and Yejin Choi. 2019 · 2019

Earlier work this paper cites.

Improving low compute language modeling with in-domain embedding initialisation

Charles Welch, Rada Mihalcea, and Jonathan K Kummerfeld. 2020 · 2020

Earlier work this paper cites.

Training verifiers to solve math word problems

Original

Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, et al. 2021 · 2021

Earlier work this paper cites.

Initializing new word embeddings for pretrained language models

John Hewitt. 2021 · 2021

Earlier work this paper cites.

Kogpt: Kakaobrain korean(hangul) generative pretrained transformer

Ildoo Kim, Gunsoo Han, Jiyeon Ham, and Woonhyuk Baek. 2021 · 2021

Earlier work this paper cites.

Kobest: Korean balanced evaluation of significant tasks

Myeongjun Jang, Dohyung Kim, Deuk Sin Kwon, and Eric Davis. 2022 · 2022

Earlier work this paper cites.

The falcon series of open language models

Original

Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, Alessandro Cappelli, Ruxandra Cojocaru, Mérouane Debbah, Étienne Goffinet, Daniel Hesslow, Julien Launay, Quentin Malartic, et al. 2023 · 2023

Cited alongside, same era.

Model card and evaluations for claude models

Anthropic. 2023 · 2023

Cited alongside, same era.

Ultrafeedback: Boosting language models with high-quality feedback

Original

Ganqu Cui, Lifan Yuan, Ning Ding, Guanming Yao, Wei Zhu, Yuan Ni, Guotong Xie, Zhiyuan Liu, and Maosong Sun. 2023 · 2023

Cited alongside, same era.

A framework for few-shot language model evaluation

Leo Gao, Jonathan Tow, Baber Abbasi, Stella Biderman, Sid Black, Anthony DiPofi, Charles Foster, Laurence Golding, Jeffrey Hsu, Alain Le Noac’h, Haonan Li, Kyle McDonell, Niklas Muennighoff, Chris Ociepa, Jason Phang, Laria Reynolds, Hailey Schoelkopf, Aviya Skowron, Lintang Sutawika, Eric Tang, Anish Thite, Ben Wang, Kevin Wang, and Andy Zou. 2023 · 2023

Cited alongside, same era.

Llama factory

hiyouga. 2023 · 2023

Gpt-4 technical report

Original

OpenAI. 2023 · 2023

Later among the works it cites.

Open ko-llm leaderboard

Chanjun Park, Hwalsuk Lee, Hyunbyung Park, Hyeonwoo Kim, Sanghoon Kim, Seonghwan Cho, Sunghun Kim, and Sukyung Lee. 2023 · 2023

Later among the works it cites.

Language model tokenizers introduce unfairness between languages

Original

Aleksandar Petrov, Emanuele La Malfa, Philip HS Torr, and Adel Bibi. 2023 · 2023

Later among the works it cites.

Direct preference optimization: Your language model is secretly a reward model

Original

Rafael Rafailov, Archit Sharma, Eric Mitchell, Stefano Ermon, Christopher D Manning, and Chelsea Finn. 2023 · 2023

Later among the works it cites.

Multilingual large language models are not (yet) code-switchers

Original