Fetching the paper…
Reading the bibliography…
When used with deep learning, the symbolic music modality is often coupled with language model architectures.
An algorithm for finding intrinsic dimensionality of data
K. Fukunaga and D.R. Olsen. 1971 · 1971
Earlier work this paper cites.
A new algorithm for data compression
Philip Gage. 1994 · 1994
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P. Kingma and Jimmy Ba. 2015 · 2015
Earlier work this paper cites.
Folk music style modelling by recurrent neural networks with long short-term memory units
Bob L. Sturm, João Felipe Santos, and Iryna Korshunova. 2015 · 2015
Earlier work this paper cites.
A Latent Variable Model Approach to PMI-based Word Embeddings
Sanjeev Arora, Yuanzhi Li, Yingyu Liang, Tengyu Ma, and Andrej Risteski. 2016 · 2016
Earlier work this paper cites.
Neural machine translation of rare words with subword units
Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016 · 2016
Earlier work this paper cites.
Google’s neural machine translation system: Bridging the gap between human and machine translation
Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V. Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, Jeff Klingner, Apurva Shah, Melvin Johnson, Xiaobing Liu, Łukasz Kaiser, Stephan Gouws, Yoshikiyo Kato, Taku Kudo, Hideto Kazawa, Keith Stevens, George Kurian, Nishant Patil, Wei Wang, Cliff Young, Jason Smith, Jason Riesa, Alex Rudnick, Oriol Vinyals, Greg Corrado, Macduff Hughes, and Jeffrey Dean. 2016 · 2016
Earlier work this paper cites.
DeepBach: a steerable model for Bach chorales generation
Gaëtan Hadjeres, François Pachet, and Frank Nielsen. 2017 · 2017
Earlier work this paper cites.
Automatic stylistic composition of bach chorales with deep LSTM
Feynman T. Liang, Mark Gotham, Matthew Johnson, and Jamie Shotton. 2017 · 2017
Earlier work this paper cites.
Using the output embedding to improve language models
Ofir Press and Lior Wolf. 2017 · 2017
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Earlier work this paper cites.
Musegan: Multi-track sequential generative adversarial networks for symbolic music generation and accompaniment
Hao-Wen Dong, Wen-Yi Hsiao, Li-Chia Yang, and Yi-Hsuan Yang. 2018 · 2018
Earlier work this paper cites.
Hierarchical neural story generation
Angela Fan, Mike Lewis, and Yann Dauphin. 2018 · 2018
Earlier work this paper cites.
Frage: Frequency-agnostic word representation
Chengyue Gong, Di He, Xu Tan, Tao Qin, Liwei Wang, and Tie-Yan Liu. 2018 · 2018
Earlier work this paper cites.
Subword regularization: Improving neural network translation models with multiple subword candidates
Taku Kudo. 2018 · 2018
Earlier work this paper cites.
Umap: Uniform manifold approximation and projection
Leland McInnes, John Healy, Nathaniel Saul, and Lukas Grossberger. 2018 · 2018
Earlier work this paper cites.
Mixed precision training
Paulius Micikevicius, Sharan Narang, Jonah Alben, Gregory Diamos, Erich Elsen, David Garcia, Boris Ginsburg, Michael Houston, Oleksii Kuchaiev, Ganesh Venkatesh, and Hao Wu. 2018 · 2018
Earlier work this paper cites.
All-but-the-top: Simple and effective postprocessing for word representations
Jiaqi Mu and Pramod Viswanath. 2018 · 2018
Earlier work this paper cites.
This time with feeling: Learning expressive musical performance
Sageev Oore, Ian Simon, Sander Dieleman, Douglas Eck, and Karen Simonyan. 2018 · 2018
Earlier work this paper cites.
Estimating the effective dimension of large biological datasets using fisher separability analysis
Luca Albergante, Jonathan Bac, and Andrei Zinovyev. 2019 · 2019
Cited alongside, same era.
BERT: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Cited alongside, same era.
Lakhnes: Improving multi-instrumental music generation with cross-domain pre-training
Chris Donahue, Huanru Henry Mao, Yiting Ethan Li, Garrison W. Cottrell, and Julian J. McAuley. 2019 · 2019
Cited alongside, same era.
How contextual are contextualized word representations? Comparing the geometry of BERT, ELMo, and GPT-2 embeddings
Kawin Ethayarajh. 2019 · 2019
Cited alongside, same era.
Representation degeneration problem in training natural language generation models
Jun Gao, Di He, Xu Tan, Tao Qin, Liwei Wang, and Tieyan Liu. 2019 · 2019
Cited alongside, same era.
From artificial neural networks to deep learning for music generation: history, concepts and trends
Jean-Pierre Briot. 2021 · 2021
Later among the works it cites.
Isotropy in the contextual embedding space: Clusters and manifolds
Xingyu Cai, Jiaji Huang, Yuchen Bian, and Kenneth Church. 2021 · 2021
Later among the works it cites.
Building the metamidi dataset: Linking symbolic and audio musical data
Jeffrey Ens and Philippe Pasquier. 2021 · 2021
Later among the works it cites.
MidiTok: A python package for MIDI file tokenization
Nathan Fradet, Jean-Pierre Briot, Fabien Chhel, Amal El Fallah Seghrouchni, and Nicolas Gutowski. 2021 · 2021
Later among the works it cites.
The piano inpainting application
Gaëtan Hadjeres and Léopold Crestel. 2021 · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Enabling factorized piano music modeling and generation with the MAESTRO dataset
Curtis Hawthorne, Andriy Stasyuk, Adam Roberts, Ian Simon, Cheng-Zhi Anna Huang, Sander Dieleman, Erich Elsen, Jesse Engel, and Douglas Eck. 2019 · 2019
Cited alongside, same era.
Musenet
Christine Payne. 2019 · 2019
Cited alongside, same era.
Language models are unsupervised multitask learners
Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019 · 2019
Cited alongside, same era.
Visualizing and measuring the geometry of bert
Emily Reif, Ann Yuan, Martin Wattenberg, Fernanda B Viegas, Andy Coenen, Adam Pearce, and Been Kim. 2019 · 2019
Cited alongside, same era.
MusicBERT: Symbolic music understanding with large-scale pre-training
Mingliang Zeng, Xu Tan, Rui Wang, Zeqian Ju, Tao Qin, and Tie-Yan Liu. 2021 · 2019
Cited alongside, same era.
Byte pair encoding is suboptimal for language model pretraining
Kaj Bostrom and Greg Durrett. 2020 · 2020
Cited alongside, same era.
Deep Learning Techniques for Music Generation
Jean-Pierre Briot, Gaëtan Hadjeres, and François-David Pachet. 2020 · 2020
Cited alongside, same era.
Compound word transformer: Learning to compose full-song music over dynamic directed hypergraphs
Wen-Yi Hsiao, Jen-Yu Liu, Yin-Cheng Yeh, and Yi-Hsuan Yang. 2021 · 2021
Later among the works it cites.
EMOPIA: A multi-modal pop piano dataset for emotion recognition and emotion-based music generation
Hsiao-Tzu Hung, Joann Ching, Seungheon Doh, Nabin Kim, Juhan Nam, and Yi-Hsuan Yang. 2021 · 2021
Later among the works it cites.
Giantmidi-piano: A large-scale midi dataset for classical piano music
Qiuqiang Kong, Bochen Li, Jitong Chen, and Yuxuan Wang. 2021 · 2021
Later among the works it cites.
Learning to remove: Towards isotropic pre-trained bert embedding
Yuxin Liang, Rui Cao, Jie Zheng, Jie Ren, and Ling Gao. 2021 · 2021
Later among the works it cites.
Long range arena : A benchmark for efficient transformers
Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, and Donald Metzler. 2021 · 2021
Later among the works it cites.
Improving tokenization expressiveness with pitch intervals
Mathieu Kermarec, Louis Bigo, and Mikaela Keller. 2022 · 2022
Later among the works it cites.
Symphony generation with permutation invariant language model
Jiafeng Liu, Yuanliang Dong, Zehua Cheng, Xinran Zhang, Xiaobing Li, Feng Yu, and Maosong Sun. 2022 · 2022
Later among the works it cites.
An isotropy analysis in the multilingual BERT embedding space
Sara Rajaee and Mohammad Taher Pilehvar. 2022 · 2022
Later among the works it cites.
IsoScore: Measuring the uniformity of embedding space utilization
William Rudman, Nate Gillman, Taylor Rayne, and Carsten Eickhoff. 2022 · 2022
Later among the works it cites.
Multitrack music transformer
Hao-Wen Dong, Ke Chen, Shlomo Dubnov, Julian McAuley, and Taylor Berg-Kirkpatrick. 2023 · 2023
Closest in time.
Impact of time and note duration tokenizations on deep learning symbolic music modeling
Nathan Fradet, Nicolas Gutowski, Fabien Chhel, and Jean-Pierre Briot. 2023 · 2023
Closest in time.
Anticipatory music transformer
John Thickstun, David Hall, Chris Donahue, and Percy Liang. 2023 · 2023
Closest in time.
FIGARO: Controllable music generation using learned and expert features
Dimitri von Rütte, Luca Biggio, Yannic Kilcher, and Thomas Hofmann. 2023 · 2023
Closest in time.