Fetching the paper…
Reading the bibliography…
Noise Contrastive Estimation (NCE) has fueled major breakthroughs in representation learning and generative modeling.
High-dimensional bayesian optimization using low-dimensional feature spaces
Riccardo Moriconi, Marc Peter Deisenroth, and KS Sesh Kumar · 1943
Earlier work this paper cites.
Simple statistical gradient-following algorithms for connectionist reinforcement learning
Ronald J Williams · 1992
Earlier work this paper cites.
Optimization of computer simulation models with rare events
Reuven Y Rubinstein · 1997
Earlier work this paper cites.
The mnist database of handwritten digits
Yann LeCun · 1998
Earlier work this paper cites.
The cross-entropy method: a unified approach to combinatorial optimization, Monte-Carlo simulation, and machine learning , volume 133
Reuven Y Rubinstein and Dirk P Kroese · 2004
Earlier work this paper cites.
The cma evolution strategy: a comparing review
Nikolaus Hansen · 2006
Earlier work this paper cites.
A tutorial on energy-based learning
Yann LeCun, Sumit Chopra, Raia Hadsell, M Ranzato, Fujie Huang, et al · 2006
Earlier work this paper cites.
Reinforcement learning by reward-weighted regression for operational space control
Jan Peters and Stefan Schaal · 2007
Earlier work this paper cites.
Learning generative models via discriminative approaches
Zhuowen Tu · 2007
Earlier work this paper cites.
The elements of statistical learning: data mining, inference, and prediction , volume 2
Trevor Hastie, Robert Tibshirani, Jerome H Friedman, and Jerome H Friedman · 2009
Earlier work this paper cites.
Learning multiple layers of features from tiny images
Alex Krizhevsky et al · 2009
Earlier work this paper cites.
Noise-contrastive estimation: A new estimation principle for unnormalized statistical models
Michael Gutmann and Aapo Hyvärinen · 2010
Earlier work this paper cites.
Estimating divergence functionals and the likelihood ratio by convex risk minimization
XuanLong Nguyen, Martin J Wainwright, and Michael I Jordan · 2010
Earlier work this paper cites.
Learning latent space energy-based prior model for molecule generation
Bo Pang, Tian Han, and Ying Nian Wu · 2010
Earlier work this paper cites.
A family of computationally efficient and simple estimators for unnormalized statistical models
Miika Pihlaja, Michael Gutmann, and Aapo Hyvärinen · 2010
Earlier work this paper cites.
Gaussian process optimization in the bandit setting: no regret and experimental design
Niranjan Srinivas, Andreas Krause, Sham Kakade, and Matthias Seeger · 2010
Earlier work this paper cites.
Adaptive subgradient methods for online learning and stochastic optimization
John Duchi, Elad Hazan, and Yoram Singer · 2011
Earlier work this paper cites.
Reading digits in natural images with unsupervised feature learning
Yuval Netzer, Tao Wang, Adam Coates, Alessandro Bissacco, Bo Wu, and Andrew Y Ng · 2011
Earlier work this paper cites.
Bayesian learning via stochastic gradient langevin dynamics
Max Welling and Yee W Teh · 2011
Earlier work this paper cites.
Noise-contrastive estimation of unnormalized statistical models, with applications to natural image statistics
Michael U Gutmann and Aapo Hyvärinen · 2012
Earlier work this paper cites.
A fast and simple algorithm for training neural probabilistic language models
A Mnih and Y Teh · 2012
Earlier work this paper cites.
Practical bayesian optimization of machine learning algorithms
Jasper Snoek, Hugo Larochelle, and Ryan P Adams · 2012
Earlier work this paper cites.
Density ratio estimation in machine learning
Masashi Sugiyama, Taiji Suzuki, and Takafumi Kanamori · 2012
Earlier work this paper cites.
Bayesian optimization in high dimensions via random embeddings
Nando de Freitas and Ziyu Wang · 2013
Earlier work this paper cites.
Auto-encoding variational bayes
Diederik P Kingma and Max Welling · 2013
Earlier work this paper cites.
Active learning of linear embeddings for gaussian processes
R Garnett, M Osborne, and P Hennig · 2014
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P Kingma and Jimmy Ba · 2014
Earlier work this paper cites.
Conditional generative adversarial nets
Mehdi Mirza and Simon Osindero · 2014
Earlier work this paper cites.
Stochastic backpropagation and approximate inference in deep generative models
Danilo Jimenez Rezende, Shakir Mohamed, and Daan Wierstra · 2014
Earlier work this paper cites.
High dimensional bayesian optimisation and bandits via additive models
Kirthevasan Kandasamy, Jeff Schneider, and Barnabás Póczos · 2015
Earlier work this paper cites.
Deep learning face attributes in the wild
Ziwei Liu, Ping Luo, Xiaogang Wang, and Xiaoou Tang · 2015
Earlier work this paper cites.
Unsupervised representation learning with deep convolutional generative adversarial networks
Alec Radford, Luke Metz, and Soumith Chintala · 2015
Earlier work this paper cites.
Taking the human out of the loop: A review of bayesian optimization
Bobak Shahriari, Kevin Swersky, Ziyu Wang, Ryan P Adams, and Nando De Freitas · 2015
Earlier work this paper cites.
Scalable bayesian optimization using deep neural networks
Jasper Snoek, Oren Rippel, Kevin Swersky, Ryan Kiros, Nadathur Satish, Narayanan Sundaram, Mostofa Patwary, Mr Prabhat, and Ryan Adams · 2015
Earlier work this paper cites.
Neural photo editing with introspective adversarial networks
Andrew Brock, Theodore Lim, James M Ritchie, and Nick Weston · 2016
Earlier work this paper cites.
Stein variational gradient descent: A general purpose bayesian inference algorithm
Qiang Liu and Dilin Wang · 2016
Earlier work this paper cites.
Linking losses for density ratio and class-probability estimation
Aditya Menon and Cheng Soon Ong · 2016
Earlier work this paper cites.
f-gan: Training generative neural samplers using variational divergence minimization
Sebastian Nowozin, Botond Cseke, and Ryota Tomioka · 2016
Earlier work this paper cites.
Instance normalization: The missing ingredient for fast stylization
Dmitry Ulyanov, Andrea Vedaldi, and Victor Lempitsky · 2016
Cited alongside, same era.
A theory of generative convnet
Jianwen Xie, Yang Lu, Song-Chun Zhu, and Yingnian Wu · 2016
Cited alongside, same era.
Alternating back-propagation for generator network
Tian Han, Yang Lu, Song-Chun Zhu, and Ying Nian Wu · 2017
Cited alongside, same era.
Gans trained by a two time-scale update rule converge to a local nash equilibrium
Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter · 2017
Cited alongside, same era.
Grammar variational autoencoder
Matt J Kusner, Brooks Paige, and José Miguel Hernández-Lobato · 2017
Cited alongside, same era.
Introspective neural networks for generative modeling
Justin Lazarow, Long Jin, and Zhuowen Tu · 2017
Telescoping density-ratio estimation
Benjamin Rhodes, Kai Xu, and Michael U Gutmann · 2020
Later among the works it cites.
Score-based generative modeling through stochastic differential equations
Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole · 2020
Later among the works it cites.
A contrastive learning approach for training variational autoencoder priors
Jyoti Aneja, Alex Schwing, Jan Kautz, and Arash Vahdat · 2021
Later among the works it cites.
Improved contrastive divergence training of energy based models
Yilun Du, Shuang Li, Joshua Tenenbaum, and Igor Mordatch · 2021
Later among the works it cites.
Analyzing and improving the optimization landscape of noise-contrastive estimation
Bingbin Liu, Elan Rosenfeld, Pradeep Kumar Ravikumar, and Andrej Risteski · 2021
Later among the works it cites.
Trajectory prediction with latent belief energy-based model
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
The reparameterization trick for acquisition functions
James T Wilson, Riccardo Moriconi, Frank Hutter, and Marc Peter Deisenroth · 2017
Cited alongside, same era.
Conditional noise-contrastive estimation of unnormalised models
Ciwan Ceylan and Michael U Gutmann · 2018
Cited alongside, same era.
Automatic chemical design using a data-driven continuous representation of molecules
Rafael Gómez-Bombarelli, Jennifer N Wei, David Duvenaud, José Miguel Hernández-Lobato, Benjamín Sánchez-Lengeling, Dennis Sheberla, Jorge Aguilera-Iparraguirre, Timothy D Hirzel, Ryan P Adams, and Alán Aspuru-Guzik · 2018
Cited alongside, same era.
Boosted generative models
Aditya Grover and Stefano Ermon · 2018
Cited alongside, same era.
Attentive neural processes
Hyunjik Kim, Andriy Mnih, Jonathan Schwarz, Marta Garnelo, Ali Eslami, Dan Rosenbaum, Oriol Vinyals, and Yee Whye Teh · 2018
Cited alongside, same era.
Glow: Generative flow with invertible 1x1 convolutions
Durk P Kingma and Prafulla Dhariwal · 2018
Cited alongside, same era.
Bo Pang, Tianyang Zhao, Xu Xie, and Ying Nian Wu · 2021
Later among the works it cites.
Learning transferable visual models from natural language supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al · 2021
Later among the works it cites.
Conservative objective models for effective offline model-based optimization
Brandon Trabucco, Aviral Kumar, Xinyang Geng, and Sergey Levine · 2021
Later among the works it cites.
Autoencoding under normalization constraints
Sangwoong Yoon, Yung-Kyun Noh, and Frank Park · 2021
Later among the works it cites.
Bidirectional learning for offline infinite-width model-based optimization
Can Chen, Yingxueff Zhang, Jie Fu, Xue Steve Liu, and Mark Coates · 2022
Later among the works it cites.
Elucidating the design space of diffusion-based generative models
Tero Karras, Miika Aittala, Timo Aila, and Samuli Laine · 2022
Later among the works it cites.
Flow matching for generative modeling
Yaron Lipman, Ricky TQ Chen, Heli Ben-Hamu, Maximilian Nickel, and Matt Le · 2022
Later among the works it cites.
Flow straight and fast: Learning to generate and transfer data with rectified flow
Xingchao Liu, Chengyue Gong, and Qiang Liu · 2022
Later among the works it cites.
Dreamfusion: Text-to-3d using 2d diffusion
Ben Poole, Ajay Jain, Jonathan T Barron, and Ben Mildenhall · 2022
Later among the works it cites.
Data-driven offline decision-making via invariant representation learning
Han Qi, Yi Su, Aviral Kumar, and Sergey Levine · 2022
Later among the works it cites.
High-resolution image synthesis with latent diffusion models
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer · 2022
Later among the works it cites.
Progressive distillation for fast sampling of diffusion models
Tim Salimans and Jonathan Ho · 2022
Later among the works it cites.
Design-bench: Benchmarks for data-driven offline model-based optimization
Brandon Trabucco, Xinyang Geng, Aviral Kumar, and Sergey Levine · 2022
Later among the works it cites.
Diffusion-gan: Training gans with diffusion
Zhendong Wang, Huangjie Zheng, Pengcheng He, Weizhu Chen, and Mingyuan Zhou · 2022
Later among the works it cites.
Adaptive multi-stage density ratio estimation for learning latent space energy-based model
Zhisheng Xiao and Tian Han · 2022
Later among the works it cites.
Latent diffusion energy-based model for interpretable text modeling
Peiyu Yu, Sirui Xie, Xiaojian Ma, Baoxiong Jia, Bo Pang, Ruiqi Gao, Yixin Zhu, Song-Chun Zhu, and Ying Nian Wu · 2022
Later among the works it cites.
Diffusion models for black-box optimization
Siddarth Krishnamoorthy, Satvik Mehul Mashkaria, and Aditya Grover · 2023
Later among the works it cites.
Diff-instruct: A universal approach for transferring knowledge from pre-trained diffusion models
Weijian Luo, Tianyang Hu, Shifeng Zhang, Jiacheng Sun, Zhenguo Li, and Zhihua Zhang · 2023
Later among the works it cites.
Generative pretraining for black-box optimization
Satvik Mehul Mashkaria, Siddarth Krishnamoorthy, and Aditya Grover · 2023
Later among the works it cites.
Consistency models
Yang Song, Prafulla Dhariwal, Mark Chen, and Ilya Sutskever · 2023
Later among the works it cites.
Prolificdreamer: High-fidelity and diverse text-to-3d generation with variational score distillation
Zhengyi Wang, Cheng Lu, Yikai Wang, Fan Bao, Chongxuan Li, Hang Su, and Jun Zhu · 2023
Later among the works it cites.
Energy-based models for anomaly detection: A manifold diffusion recovery approach
Sangwoong Yoon, Young-Uk Jin, Yung-Kyun Noh, and Frank Park · 2023
Later among the works it cites.
Parallel-mentoring for offline model-based optimization
Can Sam Chen, Christopher Beckham, Zixuan Liu, Xue Steve Liu, and Chris Pal · 2024
Closest in time.
Bootstrapped training of score-conditioned generator for offline design of biological sequences
Minsu Kim, Federico Berto, Sungsoo Ahn, and Jinkyoo Park · 2024
Closest in time.
Expt: Synthetic pretraining for few-shot experimental design
Tung Nguyen, Sudhanshu Agrawal, and Aditya Grover · 2024
Closest in time.
One-step diffusion with distribution matching distillation
Tianwei Yin, Michaël Gharbi, Richard Zhang, Eli Shechtman, Fredo Durand, William T Freeman, and Taesung Park · 2024
Closest in time.
Maximum entropy inverse reinforcement learning of diffusion models with energy-based models
Sangwoong Yoon, Himchan Hwang, Dohyun Kwon, Yung-Kyun Noh, and Frank Park · 2024
Closest in time.
Learning energy-based prior model with diffusion-amortized mcmc
Peiyu Yu, Yaxuan Zhu, Sirui Xie, Xiaojian Shawn Ma, Ruiqi Gao, Song-Chun Zhu, and Ying Nian Wu · 2024
Closest in time.
Importance-aware co-teaching for offline model-based optimization
Ye Yuan, Can Sam Chen, Zixuan Liu, Willie Neiswanger, and Xue Steve Liu · 2024
Closest in time.
The gan is dead; long live the gan! a modern gan baseline
Yiwen Huang, Aaron Gokaslan, Volodymyr Kuleshov, and James Tompkin · 2025
Closest in time.
Information theory: From coding to learning
Yury Polyanskiy and Yihong Wu · 2025
Closest in time.
Revisiting diffusion models: From generative pre-training to one-step generation
Bowen Zheng and Tianming Yang · 2025
Closest in time.