Fetching the paper…

Reading the bibliography…

2020

PIANOTREE VAE: Structured Representation Learning for Polyphonic Music

Wang, Ziyu, Zhang, Yiyi, Zhang, Yixiao et al.

Original
PDF
Post on X

Understand

The dominant approach for music representation learning involves the deep unsupervised model family variational autoencoder (VAE).

However, most, if not all, viable attempts on this problem have largely been limited to monophonic music.
Normally composed of richer modality and more complex musical structures, the polyphonic counterpart has yet to be addressed in the context of music representation learning.
In this work, we propose the PianoTree VAE, a novel tree-structure extension upon VAE aiming to fit the polyphonic music learning.

PIANOTREE VAE: Structured Representation Learning for Polyphonic Music · Around

Built on

S. W. Smoliar, “A computer aid for schenkerian analysis,” in Proceedings of the 1979 annual conference , 1979, pp. 110–115
1979
Earlier work this paper cites.
J. Rothgeb, Introduction to the theory of Heinrich Schenker: the nature of the musical work of art . New York: Longman, 1982
1982
Earlier work this paper cites.
N. B. Toomarian and J. Barhen, “Learning a trajectory using adjoint functions and teacher forcing,” Neural networks , vol. 5, no. 3, pp. 473–484, 1992
1992
Earlier work this paper cites.
A. Watt and M. Watt, “Advanced animatidn and bendering technidues,” 1992
1992
Earlier work this paper cites.
F. Lerdahl and R. S. Jackendoff, A generative theory of tonal music . MIT press, 1996
1996
Earlier work this paper cites.
H. Scheffe, The analysis of variance . John Wiley & Sons, 1999, vol. 72
Original
1999
Earlier work this paper cites.
M. Hamanaka, K. Hirata, and S. Tojo, “Implementing “a generative theory of tonal music”,” Journal of New Music Research , vol. 35, no. 4, pp. 249–277, 2006
2006
Earlier work this paper cites.
F. Scarselli, M. Gori, A. C. Tsoi, M. Hagenbuchner, and G. Monfardini, “The graph neural network model,” IEEE Transactions on Neural Networks , vol. 20, no. 1, pp. 61–80, 2008
2008
Earlier work this paper cites.
A. Marsden, “Schenkerian analysis by computer: A proof of concept,” Journal of New Music Research , vol. 39, no. 3, pp. 269–289, 2010
2010
Earlier work this paper cites.
N. Boulanger-Lewandowski, Y. Bengio, and P. Vincent, “Modeling temporal dependencies in high-dimensional sequences: Application to polyphonic music generation and transcription,” arXiv preprint arXiv:1206.6392 , 2012
Original
2012
Earlier work this paper cites.
D. P. Kingma and M. Welling, “Auto-encoding variational bayes,” arXiv preprint arXiv:1312.6114 , 2013
Original
2013
Earlier work this paper cites.
K. Cho, B. Van Merriënboer, C. Gulcehre, D. Bahdanau, F. Bougares, H. Schwenk, and Y. Bengio, “Learning phrase representations using rnn encoder-decoder for statistical machine translation,” arXiv preprint arXiv:1406.1078 , 2014
Original
2014
Earlier work this paper cites.
D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980 , 2014
Original
2014
Earlier work this paper cites.
C. Raffel, B. McFee, E. J. Humphrey, J. Salamon, O. Nieto, D. Liang, D. P. Ellis, and C. C. Raffel, “mir_eval: A transparent implementation of common mir metrics,” in In Proceedings of the 15th International Society for Music Information Retrieval Conference, ISMIR . Citeseer, 2014
2014
Earlier work this paper cites.
S. R. Bowman, L. Vilnis, O. Vinyals, A. M. Dai, R. Jozefowicz, and S. Bengio, “Generating sentences from a continuous space,” arXiv preprint arXiv:1511.06349 , 2015
Original
2015
Earlier work this paper cites.

Similar

J. Chung, K. Kastner, L. Dinh, K. Goel, A. C. Courville, and Y. Bengio, “A recurrent latent variable model for sequential data,” in Advances in neural information processing systems , 2015, pp. 2980–2988
2015
Cited alongside, same era.
——, “ σ \sigma gttm iii: Learning-based time-span tree generator based on pcfg,” in International Symposium on Computer Music Multidisciplinary Research . Springer, 2015, pp. 387–404
2015
Cited alongside, same era.
K. S. Tai, R. Socher, and C. D. Manning, “Improved semantic representations from tree-structured long short-term memory networks,” arXiv preprint arXiv:1503.00075 , 2015
Original
2015
Cited alongside, same era.
O. Mogren, “C-rnn-gan: Continuous recurrent neural networks with adversarial training,” arXiv preprint arXiv:1611.09904 , 2016
Original
2016
Cited alongside, same era.

Then

H.-W. Dong, W.-Y. Hsiao, L.-C. Yang, and Y.-H. Yang, “Musegan: Multi-track sequential generative adversarial networks for symbolic music generation and accompaniment,” in Thirty-Second AAAI Conference on Artificial Intelligence , 2018
2018
Later among the works it cites.
I. Simon, A. Roberts, C. Raffel, J. Engel, C. Hawthorne, and D. Eck, “Learning a Latent Space of Multitrack Measures,” arXiv e-prints , p. arXiv:1806.00195, Jun 2018
Original
2018
Later among the works it cites.
H. Zhu, Q. Liu, N. J. Yuan, C. Qin, J. Li, K. Zhang, G. Zhou, F. Wei, Y. Xu, and E. Chen, “Xiaoice band: A melody and arrangement generation framework for pop music,” in Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining . ACM, 2018, pp. 2837–2846
2018
Later among the works it cites.
C.-Z. A. Huang, A. Vaswani, J. Uszkoreit, N. Shazeer, C. Hawthorne, A. M. Dai, M. D. Hoffman, and D. Eck, “Music transformer: Generating music with long-term structure,” arXiv preprint arXiv:1809.04281 , 2018
Original

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

C. Dyer, A. Kuncoro, M. Ballesteros, and N. A. Smith, “Recurrent neural network grammars,” arXiv preprint arXiv:1602.07776 , 2016

2016

Cited alongside, same era.

I. Higgins, L. Matthey, A. Pal, C. Burgess, X. Glorot, M. Botvinick, S. Mohamed, and A. Lerchner, “beta-vae: Learning basic visual concepts with a constrained variational framework,” 2016

2016

Cited alongside, same era.

T. Zhao, R. Zhao, and M. Eskenazi, “Learning discourse-level diversity for neural dialog models using conditional variational autoencoders,” arXiv preprint arXiv:1703.10960 , 2017

2017

Cited alongside, same era.

L.-C. Yang, S.-Y. Chou, and Y.-H. Yang, “Midinet: A convolutional generative adversarial network for symbolic-domain music generation,” arXiv preprint arXiv:1703.10847 , 2017

2017

Cited alongside, same era.

G. Hadjeres, F. Pachet, and F. Nielsen, “Deepbach: a steerable model for bach chorales generation,” in Proceedings of the 34th International Conference on Machine Learning-Volume 70 . JMLR. org, 2017, pp. 1362–1371

2017

Cited alongside, same era.

C.-Z. A. Huang, T. Cooijmans, A. Roberts, A. Courville, and D. Eck, “Counterpoint by convolution,” in International Society for Music Information Retrieval (ISMIR) , 2017

2017

Cited alongside, same era.

G. Brunner, Y. Wang, R. Wattenhofer, and J. Wiesendanger, “Jambot: Music theory aware chord based generation of polyphonic music with lstms,” in 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI) . IEEE, 2017, pp. 519–526

2017

Cited alongside, same era.

I. Simon and S. Oore, “Performance rnn: Generating music with expressive timing and dynamics,” https://magenta.tensorflow.org/performance-rnn , 2017

2017

Cited alongside, same era.

2018

Later among the works it cites.

H. H. Mao, T. Shin, and G. Cottrell, “Deepj: Style-specific music generation,” in 2018 IEEE 12th International Conference on Semantic Computing (ICSC) . IEEE, 2018, pp. 377–382

2018

Later among the works it cites.

E. S. Koh, S. Dubnov, and D. Wright, “Rethinking recurrent latent variable model for music composition,” in 2018 IEEE 20th International Workshop on Multimedia Signal Processing (MMSP) . IEEE, 2018, pp. 1–6

2018

Later among the works it cites.

R. Yang, D. Wang, Z. Wang, T. Chen, J. Jiang, and G. Xia, “Deep music analogy via latent representation disentanglement,” arXiv preprint arXiv:1906.03626 , 2019

2019

Later among the works it cites.

A. Pati, A. Lerch, and G. Hadjeres, “Learning to traverse latent spaces for musical score inpainting,” arXiv preprint arXiv:1907.01164 , 2019

2019

Later among the works it cites.

C. Donahue, H. H. Mao, Y. E. Li, G. W. Cottrell, and J. McAuley, “Lakhnes: Improving multi-instrumental music generation with cross-domain pre-training,” arXiv preprint arXiv:1907.04868 , 2019

2019

Later among the works it cites.

D. Jeong, T. Kwon, Y. Kim, and J. Nam, “Graph neural network for music score data and modeling expressive piano performance,” in International Conference on Machine Learning , 2019, pp. 3060–3070

2019

Later among the works it cites.

R. Yang, T. Chen, Y. Zhang, and G. Xia, “Inspecting and interacting with meaningful music representations using vae,” arXiv preprint arXiv:1904.08842 , 2019

2019

Later among the works it cites.

Y.-S. Huang and Y.-H. Yang, “Pop music transformer: Generating music with rhythm and harmony,” arXiv preprint arXiv:2002.00212 , 2020

2020

Closest in time.

Z. Wang, K. Chen, J. Jiang, Y. Zhang, M. Xu, S. Dai, X. Gu, and G. Xia, “Pop909: A pop-song dataset for music arrangement generation,” in Proceedings of 21st International Conference on Music Information Retrieval (ISMIR), virtual conference , 2020

2020

Closest in time.

K. Chen, G. Xia, and S. Dubnov, “Continuous melody generation via disentangled short-term representations and structural conditions,” 2020 IEEE 14th International Conference on Semantic Computing (ICSC) , pp. 128–135, 2020

2020

Closest in time.