CharED: Character-wise Ensemble Decoding for Large Language Models

SentencePiece: A simple and language independent subword tokenizer and detokenizer for neural text processing

Kudo, T. and Richardson, J · 2012

Earlier work this paper cites.

Sequence to sequence learning with neural networks

Sutskever, I., Vinyals, O., and Le, Q. V · 2014

Earlier work this paper cites.

On using monolingual corpora in neural machine translation

Gulcehre, C., Firat, O., Xu, K., Cho, K., Barrault, L., Lin, H.-C., Bougares, F., Schwenk, H., and Bengio, Y · 2015

Earlier work this paper cites.

Zero-resource translation with multi-lingual neural machine translation

Firat, O., Sankaran, B., Al-Onaizan, Y., Vural, F. T. Y., and Cho, K · 2016

Earlier work this paper cites.

Neural machine translation of rare words with subword units

Sennrich, R., Haddow, B., and Birch, A · 2016

Earlier work this paper cites.

Character-level language modeling with hierarchical recurrent neural networks

Hwang, K. and Sung, W · 2017

Earlier work this paper cites.

Simple fusion: Return of the language model

Stahlberg, F., Cross, J., and Stoyanov, V · 2018

Earlier work this paper cites.

Character-level language modeling with deeper self-attention

Al-Rfou, R., Choe, D., Constant, N., Guo, M., and Jones, L · 2019

Earlier work this paper cites.

Bert: Pre-training of deep bidirectional transformers for language understanding

Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K · 2019

Earlier work this paper cites.

Energy and policy considerations for deep learning in NLP

Strubell, E., Ganesh, A., and McCallum, A · 2019

Earlier work this paper cites.

ERNIE: Enhanced language representation with informative entities

Original

Zhang, Z., Han, X., Liu, Z., Jiang, X., Sun, M., and Liu, Q · 2019

Earlier work this paper cites.

Evaluating large language models trained on code

Chen, M., Tworek, J., Jun, H., Yuan, Q., de Oliveira Pinto, H. P., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., Brockman, G., Ray, A., Puri, R., Krueger, G., Petrov, M., Khlaaf, H., Sastry, G., Mishkin, P., Chan, B., Gray, S., Ryder, N., Pavlov, M., Power, A., Kaiser, L., Bavarian, M., Winter, C., Tillet, P., Such, F. P., Cummings, D., Plappert, M., Chantzis, F., Barnes, E., Herbert-Voss, A., Guss, W. H., Nichol, A., Paino, A., Tezak, N., Tang, J., Babuschkin, I., Balaji, S., Jain, S., Saunders, W., Hesse, C., Carr, A. N., Leike, J., Achiam, J., Misra, V., Morikawa, E., Radford, A., Knight, M., Brundage, M., Murati, M., Mayer, K., Welinder, P., McGrew, B., Amodei, D., McCandlish, S., Sutskever, I., and Zaremba, W · 2021

Cited alongside, same era.

Training verifiers to solve math word problems

Cobbe, K., Kosaraju, V., Bavarian, M., Chen, M., Jun, H., Kaiser, L., Plappert, M., Tworek, J., Hilton, J., Nakano, R., Hesse, C., and Schulman, J · 2021

Cited alongside, same era.

Lora: Low-rank adaptation of large language models

Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., and Chen, W · 2021

Cited alongside, same era.

The power of scale for parameter-efficient prompt tuning

Lester, B., Al-Rfou, R., and Constant, N · 2021

Cited alongside, same era.

ByT5: Towards a token-free future with pre-trained byte-to-byte models

Xue, L., Barua, A., Constant, N., Al-Rfou, R., Narang, S., Kale, M., Roberts, A., and Raffel, C · 2022

Later among the works it cites.

Wizardmath: Empowering mathematical reasoning for large language models via reinforced evol-instruct

Luo, H., Sun, Q., Xu, C., Zhao, P., Lou, J., Tao, C., Geng, X., Lin, Q., Chen, S., and Zhang, D · 2023

Later among the works it cites.

Llama 2: Open foundation and fine-tuned chat models

Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., Batra, S., Bhargava, P., Bhosale, S., Bikel, D., Blecher, L., Ferrer, C. C., Chen, M., Cucurull, G., Esiobu, D., Fernandes, J., Fu, J., Fu, W., Fuller, B., Gao, C., Goswami, V., Goyal, N., Hartshorn, A., Hosseini, S., Hou, R., Inan, H., Kardas, M., Kerkez, V., Khabsa, M., Kloumann, I., Korenev, A., Koura, P. S., Lachaux, M.-A., Lavril, T., Lee, J., Liskovich, D., Lu, Y., Mao, Y., Martinet, X., Mihaylov, T., Mishra, P., Molybog, I., Nie, Y., Poulton, A., Reizenstein, J., Rungta, R., Saladi, K., Schelten, A., Silva, R., Smith, E. M., Subramanian, R., Tan, X. E., Tang, B., Taylor, R., Williams, A., Kuan, J. X., Xu, P., Yan, Z., Zarov, I., Zhang, Y., Fan, A., Kambadur, M., Narang, S., Rodriguez, A., Stojnic, R., Edunov, S., and Scialom, T · 2023

Later among the works it cites.

Chain-of-thought prompting elicits reasoning in large language models

Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., and Zhou, D · 2023

Later among the works it cites.