Fetching the paper…
Reading the bibliography…
In this work, we propose a flexible method for generating variations of discrete sequences in which tokens can be grouped into basic units, like sentences in a text or bars in music.
Noise-contrastive estimation: A new estimation principle for unnormalized statistical models
M. Gutmann and A. Hyvärinen · 2010
Earlier work this paper cites.
Product quantization for nearest neighbor search
H. Jegou, M. Douze, and C. Schmid · 2010
Earlier work this paper cites.
Auto-encoding variational bayes
D. P. Kingma and M. Welling · 2013
Earlier work this paper cites.
Music transcription modelling and composition using deep learning
B. L. Sturm, J. F. Santos, O. Ben-Tal, and I. Korshunova · 2016
Earlier work this paper cites.
Modelling symbolic music: Beyond the piano roll
C. Walder · 2016
Earlier work this paper cites.
Pixelsnail: An improved autoregressive generative model
X. Chen, N. Mishra, M. Rohaninejad, and P. Abbeel · 2017
Earlier work this paper cites.
Latent constraints: Learning to generate conditionally from unconditional generative models
J. Engel, M. Hoffman, and A. Roberts · 2017
Earlier work this paper cites.
GLSR-VAE: geodesic latent space regularization for variational autoencoder architectures
G. Hadjeres, F. Nielsen, and F. Pachet · 2017
Earlier work this paper cites.
Deepbach: a steerable model for Bach chorales generation
G. Hadjeres, F. Pachet, and F. Nielsen · 2017
Earlier work this paper cites.
Sampling Matters in Deep Embedding Learning
R. Manmatha, C. Y. Wu, A. J. Smola, and P. Krahenbuhl · 2017
Earlier work this paper cites.
Sampling variations of lead sheets
P. Roy, A. Papadopoulos, and F. Pachet · 2017
Earlier work this paper cites.
T. Salimans, A. Karpathy, X. Chen, and D. P. Kingma · 2017
Earlier work this paper cites.
Neural discrete representation learning
A. van den Oord, O. Vinyals, et al · 2017
Earlier work this paper cites.
Attention is all you need
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin · 2017
Earlier work this paper cites.
BERT: Pre-training of deep bidirectional transformers for language understanding
J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova · 2018
Cited alongside, same era.
Music transformer: Generating music with long-term structure
C.-Z. A. Huang, A. Vaswani, J. Uszkoreit, I. Simon, C. Hawthorne, N. Shazeer, A. M. Dai, M. D. Hoffman, M. Dinculescu, and D. Eck · 2018
Cited alongside, same era.
A hierarchical latent vector model for learning long-term structure in music
A. Roberts, J. Engel, C. Raffel, C. Hawthorne, and D. Eck · 2018
Cited alongside, same era.
Self-attention with relative position representations
P. Shaw, J. Uszkoreit, and A. Vaswani · 2018
Cited alongside, same era.
Representation Learning with Contrastive Predictive Coding
A. van den Oord, Y. Li, and O. Vinyals · 2018
LakhNES: Improving multi-instrumental music generation with cross-domain pre-training
C. Donahue, H. H. Mao, Y. E. Li, G. W. Cottrell, and J. McAuley · 2019
Later among the works it cites.
Piano genie
C. Donahue, I. Simon, and S. Dieleman · 2019
Later among the works it cites.
Anticipation-RNN: enforcing unary constraints in sequence generation, with application to interactive music generation
G. Hadjeres and F. Nielsen · 2019
Later among the works it cites.
Data-efficient image recognition with contrastive predictive coding
O. J. Hénaff, A. Razavi, C. Doersch, S. M. A. Eslami, and A. van den Oord · 2019
Later among the works it cites.
The curious case of neural text degeneration, 2019
A. Holtzman, J. Buys, L. Du, M. Forbes, and Y. Choi · 2019
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
vq-wav2vec: Self-supervised learning of discrete speech representations
A. Baevski, S. Schneider, and M. Auli · 2019
Cited alongside, same era.
Nonoto: A model-agnostic web interface for interactive music composition by inpainting
T. Bazin and G. Hadjeres · 2019
Cited alongside, same era.
Deep learning techniques for music generation
J.-P. Briot, G. Hadjeres, and F. Pachet · 2019
Cited alongside, same era.
Generating Long Sequences with Sparse Transformers
R. Child, S. Gray, A. Radford, and I. Sutskever · 2019
Cited alongside, same era.
Encoding musical style with transformer autoencoders
K. Choi, C. Hawthorne, I. Simon, M. Dinculescu, and J. Engel · 2019
Cited alongside, same era.
Adaptively sparse transformers
G. M. Correia, V. Niculae, and A. F. Martins · 2019
Cited alongside, same era.
Transformer-xl: Attentive language models beyond a fixed-length context
Z. Dai, Z. Yang, Y. Yang, W. W. Cohen, J. Carbonell, Q. V. Le, and R. Salakhutdinov · 2019
Cited alongside, same era.
C.-Z. A. Huang, C. Hawthorne, A. Roberts, M. Dinculescu, J. Wexler, L. Hong, and J. Howcroft · 2019
Later among the works it cites.
Large Memory Layers with Product Keys
G. Lample, A. Sablayrolles, M. Ranzato, L. Denoyer, and H. Jégou · 2019
Later among the works it cites.
Learning to traverse latent spaces for musical score inpainting
A. Pati, A. Lerch, and G. Hadjeres · 2019
Later among the works it cites.
MuseNet, 2019
C. Payne · 2019
Later among the works it cites.
Generating diverse high-fidelity images with vq-vae-2
A. Razavi, A. v. d. Oord, and O. Vinyals · 2019
Later among the works it cites.
Adaptive attention span in transformers
S. Sukhbaatar, E. Grave, P. Bojanowski, and A. Joulin · 2019
Later among the works it cites.
Z.-b. Wu and J.-q. Yu · 2019
Later among the works it cites.
A simple framework for contrastive learning of visual representations
T. Chen, S. Kornblith, M. Norouzi, and G. Hinton · 2020
Closest in time.
Reformer: The efficient transformer
N. Kitaev, Ł. Kaiser, and A. Levskaya · 2020
Closest in time.