Fetching the paper…
Reading the bibliography…
We discuss a connection between a generative model, called the diffusion model, and nonequilibrium thermodynamics for the Fokker-Planck equation, called stochastic thermodynamics.
S.-I. Amari, Learning patterns and pattern sequences by self-organizing nets of threshold elements, IEEE Transactions on computers 100
1972
Earlier work this paper cites.
N. G. Van Kampen, Stochastic differential equations, Physics reports 24
1976
Earlier work this paper cites.
J. Schnakenberg, Network theory of microscopic and macroscopic behavior of master equation systems, Reviews of Modern physics 48
1976
Earlier work this paper cites.
B. D. Anderson, Reverse-time diffusion equation models, Stochastic Processes and their Applications 12
1982
Earlier work this paper cites.
J. J. Hopfield, Neural networks and physical systems with emergent collective computational abilities., Proceedings of the national academy of sciences 79
1982
Earlier work this paper cites.
C. R. Givens and R. M. Shortt, A class of wasserstein metrics for probability distributions, Michigan Mathematical Journal 31
1984
Earlier work this paper cites.
G. E. Hinton, T. J. Sejnowski, and D. H. Ackley, Boltzmann machines: Constraint satisfaction networks that learn (Carnegie-Mellon University, Department of Computer Science Pittsburgh, PA, 1984)
1984
Earlier work this paper cites.
M. Gelbrich, On a formula for the l2 wasserstein metric between measures on euclidean and hilbert spaces, Mathematische Nachrichten 147
1990
Earlier work this paper cites.
N. G. Van Kampen, Stochastic processes in physics and chemistry , Vol. 1 (Elsevier, 1992)
1992
Earlier work this paper cites.
H. Risken and H. Risken, Fokker-planck equation (Springer, 1996)
1996
Earlier work this paper cites.
C. Jarzynski, Nonequilibrium equality for free energy differences, Physical Review Letters 78
1997
Earlier work this paper cites.
K. Sekimoto, Langevin equation and thermodynamics, Progress of Theoretical Physics Supplement 130
1998
Earlier work this paper cites.
J. Kurchan, Fluctuation theorem for stochastic dynamics, Journal of Physics A: Mathematical and General 31
1998
Earlier work this paper cites.
R. Jordan, D. Kinderlehrer, and F. Otto, The variational formulation of the fokker–planck equation, SIAM journal on mathematical analysis 29
1998
Earlier work this paper cites.
S. Brooks, Markov chain monte carlo method and its application, Journal of the royal statistical society: series D (the Statistician) 47
1998
Earlier work this paper cites.
G. E. Crooks, Entropy production fluctuation theorem and the nonequilibrium work relation for free energy differences, Physical Review E 60
1999
Earlier work this paper cites.
J.-D. Benamou and Y. Brenier, A numerical method for the optimal time-continuous mass transport problem and related problems, Contemporary mathematics 226
1999
Earlier work this paper cites.
J.-D. Benamou and Y. Brenier, A computational fluid mechanics solution to the monge-kantorovich mass transfer problem, Numerische Mathematik 84
2000
Earlier work this paper cites.
G. E. Crooks, Path-ensemble averages in systems driven far from equilibrium, Physical review E 61
2000
Earlier work this paper cites.
T. Hatano and S.-i. Sasa, Steady-state thermodynamics of langevin systems, Physical review letters 86
2001
Earlier work this paper cites.
H. Qian, Relative entropy: Free energy associated with equilibrium fluctuations and nonequilibrium deviations, Physical Review E 63
2001
Earlier work this paper cites.
D. J. Evans and D. J. Searles, The fluctuation theorem, Advances in Physics 51
2002
Earlier work this paper cites.
C. Andrieu, N. De Freitas, A. Doucet, and M. I. Jordan, An introduction to mcmc for machine learning, Machine learning 50
2003
Earlier work this paper cites.
U. Seifert, Entropy production along a stochastic trajectory and an integral fluctuation theorem, Physical review letters 95
2005
Earlier work this paper cites.
A. Hyvärinen and P. Dayan, Estimation of non-normalized statistical models by score matching., Journal of Machine Learning Research 6
2005
Earlier work this paper cites.
V. Y. Chernyak, M. Chertkov, and C. Jarzynski, Path-integral analysis of fluctuation theorems for general langevin processes, Journal of Statistical Mechanics: Theory and Experiment 2006
2006
Earlier work this paper cites.
T. Schmiedl and U. Seifert, Efficiency at maximum power: An analytically solvable model for stochastic heat engines, Europhysics letters 81
2007
Earlier work this paper cites.
R. Kawai, J. M. Parrondo, and C. Van den Broeck, Dissipation: The phase-space perspective, Physical review letters 98
2007
Earlier work this paper cites.
A. E. Allahverdyan, D. Janzing, and G. Mahler, Thermodynamic efficiency of information and heat flow, Journal of Statistical Mechanics: Theory and Experiment 2009
2009
Earlier work this paper cites.
C. Villani et al. , Optimal transport: old and new , Vol. 338 (Springer, 2009)
2009
Earlier work this paper cites.
R. Salakhutdinov and G. Hinton, Deep boltzmann machines, in Artificial intelligence and statistics (PMLR, 2009) pp. 448–455
2009
Earlier work this paper cites.
K. Sekimoto, Stochastic energetics (2010)
2010
Earlier work this paper cites.
C. Van den Broeck and M. Esposito, Three faces of the second law. ii. fokker-planck formulation, Physical Review E 82
2010
Earlier work this paper cites.
D. P. Kingma and Y. Cun, Regularized estimation of image statistics by score matching, Advances in neural information processing systems 23
2010
Earlier work this paper cites.
G. Hinton, A practical guide to training restricted boltzmann machines, Momentum 9
2010
Earlier work this paper cites.
E. Aurell, C. Mejía-Monasterio, and P. Muratore-Ginanneschi, Optimal protocols and optimal transport in stochastic thermodynamics, Physical review letters 106
2011
Earlier work this paper cites.
P. Vincent, A connection between score matching and denoising autoencoders, Neural computation 23
2011
Earlier work this paper cites.
M. Welling and Y. W. Teh, Bayesian learning via stochastic gradient langevin dynamics, in Proceedings of the 28th international conference on machine learning (ICML-11) (Citeseer, 2011) pp. 681–688
2011
Earlier work this paper cites.
U. Seifert, Stochastic thermodynamics, fluctuation theorems and molecular machines, Reports on progress in physics 75
2012
Earlier work this paper cites.
T. Sagawa and M. Ueda, Nonequilibrium thermodynamics of feedback control, Physical Review E 85
2012
Earlier work this paper cites.
E. Aurell, K. Gawȩdzki, C. Mejía-Monasterio, R. Mohayaee, and P. Muratore-Ginanneschi, Refined second law of thermodynamics for fast random processes, Journal of Statistical Physics 147
2012
Earlier work this paper cites.
G. Lan, P. Sartori, S. Neumann, V. Sourjik, and Y. Tu, The energy–speed–accuracy trade-off in sensory adaptation, Nature physics 8
2012
Earlier work this paper cites.
S. Ito and T. Sagawa, Information thermodynamics on causal networks, Physical review letters 111
2013
Earlier work this paper cites.
J. M. Horowitz and H. Sandberg, Second-law-like inequalities with information and their interpretations, New Journal of Physics 16
2014
Earlier work this paper cites.
S. Ito and T. Sagawa, Maxwell’s demon in biochemical signal transduction with feedback loop, Nature communications 6
2015
Earlier work this paper cites.
J. Sohl-Dickstein, E. Weiss, N. Maheswaranathan, and S. Ganguli, Deep unsupervised learning using nonequilibrium thermodynamics, in International conference on machine learning (PMLR, 2015) pp. 2256–2265
2015
Earlier work this paper cites.
L. Dinh, D. Krueger, and Y. Bengio, Nice: Non-linear independent components estimation, in ICLR (Workshop) (2015)
2015
Earlier work this paper cites.
D. Rezende and S. Mohamed, Variational inference with normalizing flows, in International conference on machine learning (PMLR, 2015) pp. 1530–1538
2015
Cited alongside, same era.
2015
Cited alongside, same era.
C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, Going deeper with convolutions, in Proceedings of the IEEE conference on computer vision and pattern recognition (2015) pp. 1–9
2015
Cited alongside, same era.
2015
Cited alongside, same era.
J. M. Tomczak, Deep generative modeling (Springer, 2022)
2022
Later among the works it cites.
R. Rombach, A. Blattmann, D. Lorenz, P. Esser, and B. Ommer, High-resolution image synthesis with latent diffusion models, in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (2022) pp. 10684–10695
2022
Later among the works it cites.
T. Karras, M. Aittala, T. Aila, and S. Laine, Elucidating the design space of diffusion-based generative models, Advances in Neural Information Processing Systems 35
2022
Later among the works it cites.
2022
Later among the works it cites.
J. Ho and T. Salimans, Classifier-free diffusion guidance, arXiv preprint arXiv:2207.12598 (2022)
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
A. C. Barato and U. Seifert, Thermodynamic uncertainty relation for biomolecular processes, Physical review letters 114
2015
Cited alongside, same era.
D. Kingma and J. Ba, Adam: A method for stochastic optimization, in International Conference on Learning Representations (2015)
2015
Cited alongside, same era.
2016
Cited alongside, same era.
I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning (MIT Press, 2016)
2016
Cited alongside, same era.
S.-i. Amari, Information geometry and its applications , Vol. 194 (Springer, 2016)
2016
Cited alongside, same era.
T. Salimans, I. Goodfellow, W. Zaremba, V. Cheung, A. Radford, and X. Chen, Improved techniques for training gans, Advances in neural information processing systems 29
2016
Cited alongside, same era.
T. R. Gingrich, G. M. Rotskoff, and J. M. Horowitz, Inferring dissipation from current fluctuations, Journal of Physics A: Mathematical and Theoretical 50
2017
Cited alongside, same era.
M. Arjovsky, S. Chintala, and L. Bottou, Wasserstein generative adversarial networks, in International conference on machine learning (PMLR, 2017) pp. 214–223
2017
Cited alongside, same era.
2022
Later among the works it cites.
A. Q. Nichol, P. Dhariwal, A. Ramesh, P. Shyam, P. Mishkin, B. Mcgrew, I. Sutskever, and M. Chen, Glide: Towards photorealistic image generation and editing with text-guided diffusion models, in International Conference on Machine Learning (PMLR, 2022) pp. 16784–16804
2022
Later among the works it cites.
2022
Later among the works it cites.
Y. Lipman, R. T. Chen, H. Ben-Hamu, M. Nickel, and M. Le, Flow matching for generative modeling, in The Eleventh International Conference on Learning Representations (2022)
2022
Later among the works it cites.
D. Kwon, Y. Fan, and K. Lee, Score-based generative modeling secretly minimizes the wasserstein distance, Advances in Neural Information Processing Systems 35
2022
Later among the works it cites.
V. D. Bortoli, Convergence of denoising diffusion models under the manifold hypothesis, Transactions on Machine Learning Research (2022), expert Certification
2022
Later among the works it cites.
Y. Shi, V. De Bortoli, G. Deligiannidis, and A. Doucet, Conditional simulation using diffusion schrödinger bridges, in Uncertainty in Artificial Intelligence (PMLR, 2022) pp. 1792–1802
2022
Later among the works it cites.
2022
Later among the works it cites.
2022
Later among the works it cites.
2022
Later among the works it cites.
2022
Later among the works it cites.
C. Lu, K. Zheng, F. Bao, J. Chen, C. Li, and J. Zhu, Maximum likelihood training for score-based diffusion odes by high order denoising score matching, in International Conference on Machine Learning (PMLR, 2022) pp. 14429–14460
2022
Later among the works it cites.
H. Lee, J. Lu, and Y. Tan, Convergence for score-based generative modeling with polynomial complexity, Advances in Neural Information Processing Systems 35
2022
Later among the works it cites.
2022
Later among the works it cites.
A. Dechant, Minimum entropy production, detailed balance and wasserstein distance for continuous-time markov processes, Journal of Physics A: Mathematical and Theoretical 55
2022
Later among the works it cites.
2022
Later among the works it cites.
2023
Later among the works it cites.
2023
Later among the works it cites.
K. Oko, S. Akiyama, and T. Suzuki, Diffusion models are minimax optimal distribution estimators, in International Conference on Machine Learning (PMLR, 2023) pp. 26517–26582
2023
Later among the works it cites.
N. Shaul, R. T. Chen, M. Nickel, M. Le, and Y. Lipman, On kinetic optimal probability paths for generative models, in International Conference on Machine Learning (PMLR, 2023) pp. 30883–30907
2023
Later among the works it cites.
A. Tong, N. Malkin, G. Huguet, Y. Zhang, J. Rector-Brooks, K. Fatras, G. Wolf, and Y. Bengio, Improving and generalizing flow-based generative models with minibatch optimal transport, in ICML Workshop on New Frontiers in Learning, Control, and Dynamical Systems (2023)
2023
Later among the works it cites.
X. Liu, C. Gong, and qiang liu, Flow straight and fast: Learning to generate and transfer data with rectified flow, in The Eleventh International Conference on Learning Representations (2023)
2023
Later among the works it cites.
2023
Later among the works it cites.
Q. Zhang and Y. Chen, Fast sampling of diffusion models with exponential integrator, in The Eleventh International Conference on Learning Representations (2023)
2023
Later among the works it cites.
2023
Later among the works it cites.
2023
Later among the works it cites.
A. A. Pooladian, H. Ben-Hamu, C. Domingo-Enrich, B. Amos, Y. Lipman, and R. T. Chen, Multisample flow matching: Straightening flows with minibatch couplings, Proceedings of Machine Learning Research 202
2023
Later among the works it cites.
S. Chen, S. Chewi, J. Li, Y. Li, A. Salim, and A. R. Zhang, Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions, in International Conference on Learning Representations (2023)
2023
Later among the works it cites.
K. Yoshimura, A. Kolchinsky, A. Dechant, and S. Ito, Housekeeping and excess entropy production for general nonlinear dynamics, Physical Review Research 5
2023
Later among the works it cites.
T. Van Vu and K. Saito, Thermodynamic unification of optimal transport: Thermodynamic uncertainty relation, minimum dissipation, and thermodynamic speed limits, Physical Review X 13
2023
Later among the works it cites.
S. Ito, Geometric thermodynamics for the fokker–planck equation: stochastic thermodynamic links between information geometry and optimal transport, Information Geometry 7
2024
Closest in time.
2024
Closest in time.
D. Podell, Z. English, K. Lacey, A. Blattmann, T. Dockhorn, J. Müller, J. Penna, and R. Rombach, SDXL: Improving latent diffusion models for high-resolution image synthesis, in The Twelfth International Conference on Learning Representations (2024)
2024
Closest in time.
N. M. Kornilov, P. Mokrov, A. Gasnikov, and A. Korotin, Optimal flow matching: Learning straight trajectories in just one step, in The Thirty-eighth Annual Conference on Neural Information Processing Systems (2024)
2024
Closest in time.
P. Esser, S. Kulal, A. Blattmann, R. Entezari, J. Müller, H. Saini, Y. Levi, D. Lorenz, A. Sauer, F. Boesel, D. Podell, T. Dockhorn, Z. English, and R. Rombach, Scaling rectified flow transformers for high-resolution image synthesis, in Forty-first International Conference on Machine Learning (2024)
2024
Closest in time.
2024
Closest in time.
J. Abramson, J. Adler, J. Dunger, R. Evans, T. Green, A. Pritzel, O. Ronneberger, L. Willmore, A. J. Ballard, J. Bambrick, et al. , Accurate structure prediction of biomolecular interactions with alphafold 3, Nature , 1 (2024)
2024
Closest in time.
T. Brooks, B. Peebles, C. Holmes, W. DePue, Y. Guo, L. Jing, D. Schnurr, J. Taylor, T. Luhman, E. Luhman, C. Ng, R. Wang, and A. Ramesh, Video generation models as world simulators, (2024)
2024
Closest in time.
Smithsonian butterflies subset, accessed: 2024-02-09
2024
Closest in time.
G. Biroli, T. Bonnaire, V. De Bortoli, and M. Mézard, Dynamical regimes of diffusion models, Nature Communications 15
2024
Closest in time.
J. Klinger and G. M. Rotskoff, Universal energy-speed-accuracy trade-offs in driven nonequilibrium systems, Physical Review E 111
2025
Closest in time.
K. Fukumizu, T. Suzuki, N. Isobe, K. Oko, and M. Koyama, Flow matching achieves almost minimax optimal convergence, in The Thirteenth International Conference on Learning Representations (2025)
2025
Closest in time.