Spanish and LLM Benchmarks: is MMLU Lost in Translation?

Hellaswag: Can a machine really finish your sentence?

Original

Zellers, R., Holtzman, A., Bisk, Y., Farhadi, A., and Choi, Y. (2019) · 1905

Earlier work this paper cites.

A Nation Forged by Crisis: A New American History

Sexton, J. (2018) · 2018

Earlier work this paper cites.

Beyond the imitation game: Quantifying and extrapolating the capabilities of language models

Original

Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · 2022

Earlier work this paper cites.

Gpt-4 technical report

Original

Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F. L., Almeida, D., Altenschmidt, J., Altman, S., Anadkat, S., et al. (2023) · 2023

Earlier work this paper cites.

Open llm leaderboard

Beeching, E., Fourrier, C., Habib, N., Han, S., Lambert, N., Rajani, N., Sanseviero, O., Tunstall, L., and Wolf, T. (2023) · 2023

Cited alongside, same era.

Evaluating large language models: A comprehensive survey

Original

Guo, Z., Jin, R., Liu, C., Huang, Y., Shi, D., Yu, L., Liu, Y., Li, J., Xiong, B., Xiong, D., et al. (2023) · 2023

Cited alongside, same era.

Okapi: Instruction-tuned large language models in multiple languages with reinforcement learning from human feedback

Original

Lai, V. D., Van Nguyen, C., Ngo, N. T., Nguyen, T., Dernoncourt, F., Rossi, R. A., and Nguyen, T. H. (2023) · 2023

Cited alongside, same era.

A survey of large language models

Original

Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., Dong, Z., et al. (2023) · 2023

Cited alongside, same era.

Measuring massive multitask language understanding

Hendrycks, D., Burns, C., Basart, S., Zou, A., Mazeika, M., Song, D., and Steinhardt, J. (2021a)

Cited in the paper.

Measuring mathematical problem solving with the math dataset

Original

Hendrycks, D., Burns, C., Kadavath, S., Arora, A., Basart, S., Tang, E., Song, D., and Steinhardt, J. (2021b)

Cited in the paper.

Speed and conversational large language models (llms): Not all is about tokens per second

Conde, J., González, M., Reviriego, P., Gao, Z., Liu, S., and Lombardi, F. (2024) · 2024

Closest in time.

The #somos600m project: Generating nlp resources that represent the diversity of the languages from latam, the caribbean, and spain

Grandury, M. (2024) · 2024

Closest in time.

Large language models: A survey

Original

Minaee, S., Mikolov, T., Nikzad, N., Chenaghlu, M., Socher, R., Amatriain, X., and Gao, J. (2024) · 2024

Closest in time.