Fetching the paper…
Reading the bibliography…
Training energy-based models (EBMs) on high-dimensional data can be both challenging and time-consuming, and there exists a noticeable gap in sample quality between EBMs and other generative frameworks like GANs and diffusion models.
An empirical Bayes approach to statistics
Herbert E Robbins · 1992
Earlier work this paper cites.
Filters, random fields and maximum entropy (frame): Towards a unified theory for texture modeling
Song-Chun Zhu, Ying Nian Wu, and David Mumford · 1998
Earlier work this paper cites.
Likelihood-based generative radiance field with latent space energy-based model for 3d-aware disentangled image representation
Yaxuan Zhu, Jianwen Xie, and Ping Li · 1998
Earlier work this paper cites.
Training products of experts by minimizing contrastive divergence
Geoffrey E Hinton · 2002
Earlier work this paper cites.
A tutorial on energy-based learning
Yann LeCun, Sumit Chopra, Raia Hadsell, M Ranzato, and Fujie Huang · 2006
Earlier work this paper cites.
Imagenet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei · 2009
Earlier work this paper cites.
Learning multiple layers of features from tiny images
Alex Krizhevsky and Geoffrey Hinton · 2009
Earlier work this paper cites.
Tweedie’s formula and selection bias
Bradley Efron · 2011
Earlier work this paper cites.
Learning deep energy models
Jiquan Ngiam, Zhenghao Chen, Pang Wei Koh, and Andrew Y. Ng · 2011
Earlier work this paper cites.
A practical guide to training restricted boltzmann machines
Geoffrey E. Hinton · 2012
Earlier work this paper cites.
Generalized denoising auto-encoders as generative models
Yoshua Bengio, Li Yao, Guillaume Alain, and Pascal Vincent · 2013
Earlier work this paper cites.
Auto-encoding variational bayes
Diederik P. Kingma and Max Welling · 2014
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P. Kingma and Jimmy Ba · 2015
Earlier work this paper cites.
Deep learning face attributes in the wild
Ziwei Liu, Ping Luo, Xiaogang Wang, and Xiaoou Tang · 2015
Earlier work this paper cites.
U-net: Convolutional networks for biomedical image segmentation
Olaf Ronneberger, Philipp Fischer, and Thomas Brox · 2015
Earlier work this paper cites.
Deep unsupervised learning using nonequilibrium thermodynamics
Jascha Sohl-Dickstein, Eric A. Weiss, Niru Maheswaranathan, and Surya Ganguli · 2015
Earlier work this paper cites.
Deep directed generative models with energy-based probability estimation
Taesup Kim and Yoshua Bengio · 2016
Earlier work this paper cites.
Improved techniques for training gans
Tim Salimans, Ian J. Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, and Xi Chen · 2016
Earlier work this paper cites.
A theory of generative convnet
Jianwen Xie, Yang Lu, Song-Chun Zhu, and Ying Nian Wu · 2016
Earlier work this paper cites.
Improved training of wasserstein gans
Ishaan Gulrajani, Faruk Ahmed, Martin Arjovsky, Vincent Dumoulin, and Aaron Courville · 2017
Earlier work this paper cites.
Gans trained by a two time-scale update rule converge to a local nash equilibrium
Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter · 2017
Earlier work this paper cites.
Introspective classification with convolutional nets
Long Jin, Justin Lazarow, and Zhuowen Tu · 2017
Earlier work this paper cites.
Introspective neural networks for generative modeling
Justin Lazarow, Long Jin, and Zhuowen Tu · 2017
Earlier work this paper cites.
Pixelcnn++: Improving the pixelcnn with discretized logistic mixture likelihood and other modifications
Tim Salimans, Andrej Karpathy, Xi Chen, and Diederik P. Kingma · 2017
Earlier work this paper cites.
Learning generative convnets via multi-grid modeling and sampling
Ruiqi Gao, Yang Lu, Junpei Zhou, Song-Chun Zhu, and Ying Nian Wu · 2018
Earlier work this paper cites.
Glow: Generative flow with invertible 1x1 convolutions
Diederik P. Kingma and Prafulla Dhariwal · 2018
Earlier work this paper cites.
Wasserstein introspective neural networks
Kwonjoon Lee, Weijian Xu, Fan Fan, and Zhuowen Tu · 2018
Earlier work this paper cites.
Spectral normalization for generative adversarial networks
Takeru Miyato, Toshiki Kataoka, Masanori Koyama, and Yuichi Yoshida · 2018
Earlier work this paper cites.
Autoregressive quantile networks for generative modeling
Georg Ostrovski, Will Dabney, and Rémi Munos · 2018
Earlier work this paper cites.
Large scale GAN training for high fidelity natural image synthesis
Andrew Brock, Jeff Donahue, and Karen Simonyan · 2019
Earlier work this paper cites.
Residual flows for invertible generative modeling
Ricky TQ Chen, Jens Behrmann, David Duvenaud, and Jörn-Henrik Jacobsen · 2019
Cited alongside, same era.
Implicit generation and generalization in energy-based models
Yilun Du and Igor Mordatch · 2019
Cited alongside, same era.
Divergence triangle for joint training of generator model, energy-based model, and inferential model
Tian Han, Erik Nijkamp, Xiaolin Fang, Mitch Hill, Song-Chun Zhu, and Ying Nian Wu · 2019
Cited alongside, same era.
Maximum entropy generators for energy-based models
Rithesh Kumar, Sherjil Ozair, Anirudh Goyal, Aaron Courville, and Yoshua Bengio · 2019
Cited alongside, same era.
Decoupled weight decay regularization
Ilya Loshchilov and Frank Hutter · 2019
Cited alongside, same era.
Graphebm: Molecular graph generation with energy-based models
Meng Liu, Keqiang Yan, Bora Oztekin, and Shuiwang Ji · 2021
Later among the works it cites.
Knowledge distillation in iterative generative models for improved sampling speed
Eric Luhman and Troy Luhman · 2021
Later among the works it cites.
Improved denoising diffusion probabilistic models
Alexander Quinn Nichol and Prafulla Dhariwal · 2021
Later among the works it cites.
Dual contradistinctive generative autoencoder
Gaurav Parmar, Dacheng Li, Kwonjoon Lee, and Zhuowen Tu · 2021
Later among the works it cites.
Should ebms model the energy or the score?
Tim Salimans and Jonathan Ho · 2021
Later among the works it cites.
Vaebm: A symbiosis between variational autoencoders and energy-based models
Zhisheng Xiao, Karsten Kreis, Jan Kautz, and Arash Vahdat · 2021
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Learning non-convergent non-persistent short-run MCMC toward energy-based model
Erik Nijkamp, Mitch Hill, Song-Chun Zhu, and Ying Nian Wu · 2019
Cited alongside, same era.
Generative modeling by estimating gradients of the data distribution
Yang Song and Stefano Ermon · 2019
Cited alongside, same era.
Your gan is secretly an energy-based model and you should use discriminator driven latent sampling
Tong Che, Ruixiang Zhang, Jascha Sohl-Dickstein, Hugo Larochelle, Liam Paull, Yuan Cao, and Yoshua Bengio · 2020
Cited alongside, same era.
Compositional visual generation with energy based models
Yilun Du, Shuang Li, and Igor Mordatch · 2020
Cited alongside, same era.
Flow contrastive estimation of energy-based models
Ruiqi Gao, Erik Nijkamp, Diederik P. Kingma, Zhen Xu, Andrew M Dai, and Ying Nian Wu · 2020
Cited alongside, same era.
Generative adversarial networks
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio · 2020
Cited alongside, same era.
Your classifier is secretly an energy based model and you should treat it like one
Will Grathwohl, Kuan-Chieh Wang, Jörn-Henrik Jacobsen, David Duvenaud, Mohammad Norouzi, and Kevin Swersky · 2020
Cited alongside, same era.
Later among the works it cites.
Learning energy-based generative models via coarse-to-fine expanding and sampling
Yang Zhao, Jianwen Xie, and Ping Li · 2021
Later among the works it cites.
Maximum likelihood learning of energy-based models for simulation-based inference
Pierre Glaser, Michael Arbel, Arnaud Doucet, and Arthur Gretton · 2022
Later among the works it cites.
Learning probabilistic models from generator latent spaces with hat ebm
Mitch Hill, Erik Nijkamp, Jonathan Mitchell, Bo Pang, and Song-Chun Zhu · 2022
Later among the works it cites.
Classifier-free diffusion guidance
Jonathan Ho and Tim Salimans · 2022
Later among the works it cites.
Elucidating the design space of diffusion-based generative models
Tero Karras, Miika Aittala, Timo Aila, and Samuli Laine · 2022
Later among the works it cites.
End-to-end stochastic optimization with energy-based model
Lingkai Kong, Jiaming Cui, Yuchen Zhuang, Rui Feng, B. Aditya Prakash, and Chao Zhang · 2022
Later among the works it cites.
Flow matching for generative modeling
Yaron Lipman, Ricky TQ Chen, Heli Ben-Hamu, Maximilian Nickel, and Matt Le · 2022
Later among the works it cites.
Dpm-solver: A fast ODE solver for diffusion probabilistic model sampling in around 10 steps
Cheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen, Chongxuan Li, and Jun Zhu · 2022
Later among the works it cites.
Learning energy-based model with flow-based backbone by neural transport mcmc
Erik Nijkamp, Ruiqi Gao, Pavel Sountsov, Srinivas Vasudevan, Bo Pang, Song-Chun Zhu, and Ying Nian Wu · 2022
Later among the works it cites.
Hierarchical text-conditional image generation with clip latents
Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen · 2022
Later among the works it cites.
High-resolution image synthesis with latent diffusion models
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer · 2022
Later among the works it cites.
Photorealistic text-to-image diffusion models with deep language understanding
Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily L. Denton, Seyed Kamyar Seyed Ghasemipour, Raphael Gontijo Lopes, Burcu Karagol Ayan, Tim Salimans, Jonathan Ho, David J. Fleet, and Mohammad Norouzi · 2022
Later among the works it cites.
Progressive distillation for fast sampling of diffusion models
Tim Salimans and Jonathan Ho · 2022
Later among the works it cites.
Adaptive multi-stage density ratio estimation for learning latent space energy-based model
Zhisheng Xiao and Tian Han · 2022
Later among the works it cites.
Tackling the generative learning trilemma with denoising diffusion gans
Zhisheng Xiao, Karsten Kreis, and Arash Vahdat · 2022
Later among the works it cites.
Learning energy-based models with adversarial training
Xuwang Yin, Shiying Li, and Gustavo K Rohde · 2022
Later among the works it cites.
Learning energy-based model via dual-mcmc teaching
Jiali Cui and Tian Han · 2023
Closest in time.
Reduce, reuse, recycle: Compositional generation with energy-based diffusion models and mcmc
Yilun Du, Conor Durkan, Robin Strudel, Joshua B Tenenbaum, Sander Dieleman, Rob Fergus, Jascha Sohl-Dickstein, Arnaud Doucet, and Will Grathwohl · 2023
Closest in time.
Egc: Image generation and classification via a diffusion energy-based model
Qiushan Guo, Chuofan Ma, Yi Jiang, Zehuan Yuan, Yizhou Yu, and Ping Luo · 2023
Closest in time.
Guiding energy-based models via contrastive latent variables
Hankook Lee, Jongheon Jeong, Sejun Park, and Jinwoo Shin · 2023
Closest in time.
Energy-based models for anomaly detection: A manifold diffusion recovery approach
Sangwoong Yoon, Young-Uk Jin, Yung-Kyun Noh, and Frank C Park · 2023
Closest in time.
Learning energy-based prior model with diffusion-amortized mcmc
Peiyu Yu, Yaxuan Zhu, Sirui Xie, Xiaojian Shawn Ma, Ruiqi Gao, Song-Chun Zhu, and Ying Nian Wu · 2023
Closest in time.
An energy-based prior for generative saliency
Jing Zhang, Jianwen Xie, Nick Barnes, and Ping Li · 2023
Closest in time.