2019

Adversarial Learning of a Sampler Based on an Unnormalized Distribution

Li, Chunyuan, Bai, Ke, Li, Jianqiao et al.

Understand

We investigate adversarial learning in the case when only an unnormalized form of the density can be accessed, rather than samples.

With insights so garnered, adversarial learning is extended to the case for which one has access to an unnormalized form u(x) of the target density function, but no samples.
Further, new concepts in GAN regularization are developed, based on learning from samples or from u(x).
The proposed method is compared to alternative approaches, with encouraging results demonstrated across a range of applications, including deep soft Q-learning.

Built on

On the problem of the most efficient tests of statistical hypotheses
Neyman, J. and Pearson, E. S. (1933) · 1933
Earlier work this paper cites.
Monte Carlo sampling methods using Markov Chains and their applications
Hastings, W. (1970) · 1970
Earlier work this paper cites.
Bayesian data analysis
Gelman, A., Carlin, J. B., S., S. H., and Rubin, D. B. (1995) · 1995
Earlier work this paper cites.
Expectation propagation for approximate Bayesian inference
Minka, T. P. (2001) · 2001
Earlier work this paper cites.
Detection, estimation, and modulation theory
Van Trees, H. L. (2001) · 2001
Earlier work this paper cites.
Noise-contrastive estimation: A new estimation principle for unnormalized statistical models
Gutmann, M. and Hyvärinen, A. (2010) · 2010
Earlier work this paper cites.
Potentials of mean force for protein structure prediction vindicated, formalized and generalized
Hamelryck, T., Borg, M., Paluszewski, M., Paulsen, J., Frellsen, J., Andreetta, C., Boomsma, W., Bottaro, S., and Ferkinghoff-Borg, J. (2010) · 2010
Earlier work this paper cites.
Theoretical analysis of density ratio estimation
Kanamori, T., Suzuki, T., and Sugiyama, M. (2010) · 2010
Earlier work this paper cites.
Handbook of Markov Chain Monte Carlo
Brooks, S., Gelman, A., Jones, G., and Meng, X.-L. (2011) · 2011
Earlier work this paper cites.
Bayesian learning via stochastic gradient Langevin dynamics
Welling, M. and Teh, Y. W. (2011) · 2011
Earlier work this paper cites.
Imagenet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., and Hinton, G. E. (2012) · 2012
Earlier work this paper cites.
Stochastic variational inference
Hoffman, M. D., Blei, D. M., Wang, C., and Paisley, J. (2013) · 2013
Earlier work this paper cites.
Generative adversarial nets
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014) · 2014
Earlier work this paper cites.

Similar

Auto-encoding variational Bayes
Kingma, D. P. and Welling, M. (2014) · 2014
Cited alongside, same era.
Stochastic backpropagation and approximate inference in deep generative models
Rezende, D. J., Mohamed, S., and Wierstra, D. (2014) · 2014
Cited alongside, same era.
Stochastic expectation propagation
Li, Y., Hernández-Lobato, J. M., and Turner, R. E. (2015) · 2015
Cited alongside, same era.
Deep learning face attributes in the wild
Liu, Z., Luo, P., Wang, X., and Tang, X. (2015) · 2015
Cited alongside, same era.
Openai gym
Original
Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J., and Zaremba, W. (2016) · 2016
Cited alongside, same era.
InfoGAN: Interpretable representation learning by information maximizing generative adversarial nets
Chen, X., Duan, Y., Houthooft, R., Schulman, J., Sutskever, I., and Abbeel, P. (2016) · 2016
Cited alongside, same era.
Benchmarking deep reinforcement learning for continuous control
Duan, Y., Chen, X., Houthooft, R., Schulman, J., and Abbeel, P. (2016) · 2016
Cited alongside, same era.
Stein variational gradient descent: A general purpose Bayesian inference algorithm
Liu, Q. and Wang, D. (2016) · 2016
Cited alongside, same era.
Learning in implicit generative models
Mohamed, S. and L., B. (2016) · 2016
Cited alongside, same era.
f-GAN: Training generative neural samplers using variational divergence minimization
Nowozin, S., Cseke, B., and Tomioka, R. (2016) · 2016
Cited alongside, same era.
Pixel recurrent neural network
Oord, A., Kalchbrenner, N., and Kavukcuoglu, K. (2016) · 2016
Cited alongside, same era.
Unsupervised representation learning with deep convolutional generative adversarial networks
Radford, A., Metz, L., and Chintala, S. (2016) · 2016
Cited alongside, same era.

Then

Learning to draw samples: With application to amortized MLE for generative adversarial learning
Original
Wang, D. and Liu, Q. (2016) · 2016
Later among the works it cites.
Learning to draw samples with amortized stein variational gradient descent
Feng, Y., Wang, D., and Liu, Q. (2017) · 2017
Later among the works it cites.
Reinforcement learning with deep energy-based policies
Haarnoja, T., Tang, H., Abbeel, P., and Levine, S. (2017) · 2017
Later among the works it cites.
GANs trained by a two time-scale update rule converge to a Nash equilibrium
Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., Klambauer, G., and Hochreiter, S. (2017) · 2017
Later among the works it cites.
Adversarial variational Bayes: Unifying variational autoencoders and generative adversarial networks
Mescheder, L., Nowozin, S., and Geiger, A. (2017) · 2017
Later among the works it cites.
Unrolled generative adversarial networks
Metz, L., Poole, B., Pfau, D., and Sohl-Dickstein, J. (2017) · 2017
Later among the works it cites.
Dual discriminator generative adversarial nets
Nguyen, T., Le, T., Vu, H., and Phung, D. (2017) · 2017
Later among the works it cites.
VAE learning via Stein variational gradient descent
Y. Pu, Z. Gan, R. H. C. L. S. H. and Carin, L. (2017) · 2017
Later among the works it cites.
Unpaired image-to-image translation using cycle-consistent adversarial networks
Zhu, J.-Y., Park, T., Isola, P., and Efros, A. (2017) · 2017
Later among the works it cites.
Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor
Haarnoja, T., Zhou, A., Abbeel, P., and Levine, S. (2018) · 2018
Later among the works it cites.
Learning to sample with adversarially learned likelihood-ratio
Li, C., Li, J., Wang, G., and Carin, L. (2018) · 2018
Later among the works it cites.
Spectral normalization for generative adversarial networks
Miyato, T., Kataoka, T., Koyama, M., and Yoshida, Y. (2018) · 2018
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…