Fetching the paper…
Reading the bibliography…
To apply neural sequence models such as the Transformers to music generation tasks, one has to represent a piece of music by a sequence of tokens drawn from a finite set of pre-defined vocabulary.
Generating long sequences with sparse Transformers
Child, R.; Gray, S.; Radford, A.; and Sutskever, I. 2019 · 1904
Earlier work this paper cites.
CTRL: A conditional Transformer language model for controllable generation
Keskar, N. S.; McCann, B.; Varshney, L. R.; Xiong, C.; and Socher, R. 2019 · 1909
Earlier work this paper cites.
A learning algorithm for Boltzmann machines
Ackley, D. H.; Hinton, G. E.; and Sejnowski, T. J. 1985 · 1985
Earlier work this paper cites.
Realtime chord recognition of musical sound: A system using common Lisp
Fujishima, T. 1999 · 1999
Earlier work this paper cites.
Melodic matching techniques for large music databases
Uitdenbogerd, A.; and Zobel, J. 1999 · 1999
Earlier work this paper cites.
Language, music, syntax and the brain
Patel, A. D. 2003 · 2003
Earlier work this paper cites.
Rethinking positional encoding in language pre-training
Ke, G.; He, D.; and Liu, T.-Y. 2020 · 2006
Earlier work this paper cites.
Temporal graph networks for deep learning on dynamic graphs
Rossi, E.; Chamberlain, B.; Frasca, F.; Eynard, D.; Monti, F.; and Bronstein, M. 2020 · 2006
Earlier work this paper cites.
MMM- Exploring conditional multi-track music generation with the Transformer
Ens, J.; and Pasquier, P. 2020 · 2008
Earlier work this paper cites.
Multilayer networks
Kivelä, M.; Arenas, A.; Barthelemy, M.; Gleeson, J. P.; Moreno, Y.; and Porter, M. A. 2014 · 2014
Earlier work this paper cites.
Madmom: A new Python audio and music signal processing library
Böck, S.; Korzeniowski, F.; Schlüter, J.; Krebs, F.; and Widmer, G. 2016 · 2016
Earlier work this paper cites.
Attention is all you need
Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A. N.; Kaiser, Ł.; and Polosukhin, I. 2017 · 2017
Cited alongside, same era.
Adaptive input representations for neural language modeling
Baevski, A.; and Auli, M. 2018 · 2018
Cited alongside, same era.
This time with feeling: Learning expressive musical performance
Oore, S.; Simon, I.; Dieleman, S.; Eck, D.; and Simonyan, K. 2018 · 2018
Cited alongside, same era.
Transformer-XL: Attentive language models beyond a fixed-Length context
Dai, Z.; Yang, Z.; Yang, Y.; Carbonell, J.; Le, Q.; and Salakhutdinov, R. 2019 · 2019
Cited alongside, same era.
LakhNES: Improving multi-instrumental music generation with cross-domain pre-training
Donahue, C.; Mao, H. H.; Li, Y. E.; Cottrell, G. W.; and McAuley, J. 2019 · 2019
Cited alongside, same era.
Hypergraph neural networks
Encoding musical style with transformer autoencoders
Choi, K.; Hawthorne, C.; Simon, I.; Dinculescu, M.; and Engel, J. 2020 · 2020
Later among the works it cites.
MusPy: A toolkit for symbolic music generation
Dong, H.-W.; Chen, K.; McAuley, J.; and Berg-Kirkpatrick, T. 2020 · 2020
Later among the works it cites.
The curious case of neural text degeneration
Holtzman, A.; Buys, J.; Du, L.; Forbes, M.; and Choi, Y. 2020 · 2020
Later among the works it cites.
Pop Music Transformer: Beat-based modeling and generation of expressive Pop piano compositions
Huang, Y.-S.; and Yang, Y.-H. 2020 · 2020
Later among the works it cites.
Transformer VAE: A hierarchical model for structure-aware and interpretable music representation learning
Jiang, J.; Xia, G. G.; Carlton, D. B.; Anderson, C. N.; and Miyakawa, R. H. 2020 · 2020
Later among the works it cites.
Transformers are RNNs: Fast autoregressive Transformers with linear attention
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Feng, Y.; You, H.; Zhang, Z.; Ji, R.; and Gao, Y. 2019 · 2019
Cited alongside, same era.
Music Transformer: Generating music with long-term structure
Huang, C.-Z. A.; Vaswani, A.; Uszkoreit, J.; Simon, I.; Hawthorne, C.; Shazeer, N.; Dai, A. M.; Hoffman, M. D.; Dinculescu, M.; and Eck, D. 2019 · 2019
Cited alongside, same era.
Modeling Self-Repetition in Music Generation using Generative Adversarial Networks
Jhamtani, H.; and Berg-Kirkpatrick, T. 2019 · 2019
Cited alongside, same era.
Dynamic hypergraph neural networks
Jiang, J.; Wei, Y.; Feng, Y.; Cao, J.; and Gao, Y. 2019 · 2019
Cited alongside, same era.
Music performance analysis: A survey
Lerch, A.; Arthur, C.; Pati, A.; and Gururani, S. 2019 · 2019
Cited alongside, same era.
Automatic composition of guitar tabs by Transformers and groove modeling
Chen, Y.-H.; Huang, Y.-S.; Hsiao, W.-Y.; and Yang, Y.-H. 2020 · 2020
Cited alongside, same era.
Onsets and Frames: Dual-objective piano transcription
Hawthorne, C.; Elsen, E.; Song, J.; Roberts, A.; Simon, I.; Raffel, C.; Engel, J.; Oore, S.; and Eck, D. 2018a
Cited in the paper.
Katharopoulos, A.; Vyas, A.; Pappas, N.; and Fleuret, F. 2020 · 2020
Later among the works it cites.
Representation learning for dynamic graphs: A survey
Kazemi, S. M.; Goel, R.; Jain, K.; Kobyzev, I.; Sethi, A.; Forsyth, P.; and Poupart, P. 2020 · 2020
Later among the works it cites.
Compressive Transformers for long-range sequence modelling
Rae, J. W.; Potapenko, A.; Jayakumar, S. M.; Hillier, C.; and Lillicrap, T. P. 2020 · 2020
Later among the works it cites.
Exploring the limits of transfer learning with a unified text-to-text Transformer
Raffel, C.; Shazeer, N.; Roberts, A.; Lee, K.; Narang, S.; Matena, M.; Zhou, Y.; Li, W.; and Liu, P. J. 2020 · 2020
Later among the works it cites.
The Jazz Transformer on the front line: Exploring the shortcomings of AI-composed music through quantitative measures
Wu, S.-L.; and Yang, Y.-H. 2020 · 2020
Later among the works it cites.
On the evaluation of generative models in music
Yang, L.-C.; and Lerch, A. 2020 · 2020
Later among the works it cites.