Exploring the Efficacy of Pre-trained Checkpoints in Text-to-Music Generation Task

Bleu: a Method for Automatic Evaluation of Machine Translation

Papineni, K.; Roukos, S.; Ward, T.; and Zhu, W.-J. 2002 · 2002

Earlier work this paper cites.

Jukebox: A Generative Model for Music

Original

Dhariwal, P.; Jun, H.; Payne, C.; Kim, J. W.; Radford, A.; and Sutskever, I. 2020 · 2005

Earlier work this paper cites.

Crowdsourcing a Word-Emotion Association Lexicon

Mohammad, S. M.; and Turney, P. D. 2013 · 2013

Earlier work this paper cites.

Generating Music from Literature

Davis, H.; and Mohammad, S. M. 2014 · 2014

Earlier work this paper cites.

Generating music from natural language text

Rangarajan, R. 2015 · 2015

Earlier work this paper cites.

A Diversity-Promoting Objective Function for Neural Conversation Models

Li, J.; Galley, M.; Brockett, C.; Gao, J.; and Dolan, B. 2016 · 2016

Earlier work this paper cites.

Attention is All you Need

Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A. N.; Kaiser, L.; and Polosukhin, I. 2017 · 2017

Earlier work this paper cites.

Generating Wikipedia by Summarizing Long Sequences

Liu, P. J.; Saleh, M.; Pot, E.; Goodrich, B.; Sepassi, R.; Kaiser, L.; and Shazeer, N. 2018 · 2018

Earlier work this paper cites.

Improving language understanding by generative pre-training

Radford, A.; Narasimhan, K.; Salimans, T.; Sutskever, I.; et al. 2018 · 2018

Cited alongside, same era.

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Devlin, J.; Chang, M.; Lee, K.; and Toutanova, K. 2019 · 2019

Cited alongside, same era.

Language models are unsupervised multitask learners

Radford, A.; Wu, J.; Child, R.; Luan, D.; Amodei, D.; Sutskever, I.; et al. 2019 · 2019

Cited alongside, same era.

Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

Reimers, N.; and Gurevych, I. 2019 · 2019

Cited alongside, same era.

Language Models are Few-Shot Learners

Brown, T. B.; Mann, B.; Ryder, N.; Subbiah, M.; Kaplan, J.; Dhariwal, P.; Neelakantan, A.; Shyam, P.; Sastry, G.; Askell, A.; Agarwal, S.; Herbert-Voss, A.; Krueger, G.; Henighan, T.; Child, R.; Ramesh, A.; Ziegler, D. M.; Wu, J.; Winter, C.; Hesse, C.; Chen, M.; Sigler, E.; Litwin, M.; Gray, S.; Chess, B.; Clark, J.; Berner, C.; McCandlish, S.; Radford, A.; Sutskever, I.; and Amodei, D. 2020 · 2020

Cited alongside, same era.

BUTTER: A representation learning framework for bi-directional music-sentence retrieval and generation

Zhang, Y.; Wang, Z.; Wang, D.; and Xia, G. 2020 · 2020

Later among the works it cites.

From artificial neural networks to deep learning for music generation: history, concepts and trends

Briot, J. 2021 · 2021

Later among the works it cites.

Evaluating Large Language Models Trained on Code

Original

Chen, M.; Tworek, J.; Jun, H.; Yuan, Q.; de Oliveira Pinto, H. P.; Kaplan, J.; Edwards, H.; Burda, Y.; Joseph, N.; Brockman, G.; Ray, A.; Puri, R.; Krueger, G.; Petrov, M.; Khlaaf, H.; Sastry, G.; Mishkin, P.; Chan, B.; Gray, S.; Ryder, N.; Pavlov, M.; Power, A.; Kaiser, L.; Bavarian, M.; Winter, C.; Tillet, P.; Such, F. P.; Cummings, D.; Plappert, M.; Chantzis, F.; Barnes, E.; Herbert-Voss, A.; Guss, W. H.; Nichol, A.; Paino, A.; Tezak, N.; Tang, J.; Babuschkin, I.; Balaji, S.; Jain, S.; Saunders, W.; Hesse, C.; Carr, A. N.; Leike, J.; Achiam, J.; Misra, V.; Morikawa, E.; Radford, A.; Knight, M.; Brundage, M.; Murati, M.; Mayer, K.; Welinder, P.; McGrew, B.; Amodei, D.; McCandlish, S.; Sutskever, I.; and Zaremba, W. 2021 · 2021

Later among the works it cites.

LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairs

Original

Schuhmann, C.; Vencu, R.; Beaumont, R.; Kaczmarczyk, R.; Mullis, C.; Katta, A.; Coombes, T.; Jitsev, J.; and Komatsuzaki, A. 2021 · 2021