Fetching the paper…
Reading the bibliography…
This paper aims to develop and provide a rigorous treatment to the problem of entropy regularized fine-tuning in the context of continuous-time diffusion models, which was recently proposed by Uehara et al.
Various techniques used in connection with random digits
J. von Neumann · 1951
Earlier work this paper cites.
A general ergodic theorem
R. V. Chacon and D. S. Ornstein · 1960
Earlier work this paper cites.
Markoff-Ketten bei sich füllenden Löchern im Zustandsraum
H. Rost · 1971
Earlier work this paper cites.
Multidimensional diffusion processes
D. W. Stroock and S. R. S. Varadhan · 1979
Earlier work this paper cites.
Reverse-time diffusion equation models
B. D. O. Anderson · 1982
Earlier work this paper cites.
Asymptotic evaluation of certain Markov process expectations for large time. IV
M. D. Donsker and S. R. S. Varadhan · 1983
Earlier work this paper cites.
Time reversal of diffusions
U. G. Haussmann and E. Pardoux · 1986
Earlier work this paper cites.
Nonlinear elliptic and parabolic equations of the second order
N. V. Krylov · 1987
Earlier work this paper cites.
Brownian motion and stochastic calculus
I. Karatzas and S. E. Shreve · 1991
Earlier work this paper cites.
Applications of Malliavin calculus to Monte Carlo methods in finance
E. Fournié, J.-M. Lasry, J. Lebuchoux, P.-L. Lions, and N. Touzi · 1999
Earlier work this paper cites.
Stochastic controls
J. Yong and X. Y. Zhou · 1999
Earlier work this paper cites.
Convex optimization
S. Boyd and L. Vandenberghe · 2004
Earlier work this paper cites.
Sensitivity analysis using Itô-Malliavin calculus and martingales, and application to stochastic optimal control
E. Gobet and R. Munos · 2005
Earlier work this paper cites.
Estimation of non-normalized statistical models by score matching
A. Hyvärinen · 2005
Earlier work this paper cites.
Malliavin Greeks without Malliavin calculus
N. Chen and P. Glasserman · 2007
Earlier work this paper cites.
A connection between score matching and denoising autoencoders
P. Vincent · 2011
Cited alongside, same era.
Patterns in random walks and Brownian motion
J. Pitman and W. Tang · 2015
Cited alongside, same era.
Deep unsupervised learning using nonequilibrium thermodynamics
J. Sohl-Dickstein, E. Weiss, N. Maheswaranathan, and S. Ganguli · 2015
Cited alongside, same era.
Neural ordinary differential equations
R. T. Chen, Y. Rubanova, J. Bettencourt, and D. K. Duvenaud · 2018
Cited alongside, same era.
Denoising diffusion probabilistic models
J. Ho, A. Jain, and P. Abbeel · 2020
Cited alongside, same era.
Sliced score matching: A scalable approach to density and score estimation
Y. Song, S. Garg, J. Shi, and S. Ermon · 2020
Cited alongside, same era.
Optimizing DDPM sampling with shortcut fine-tuning
Y. Fan and K. Lee · 2023
Later among the works it cites.
DPOK: Reinforcement learning for fine-tuning text-to-image diffusion models
Y. Fan, O. Watkins, Y. Du, H. Liu, M. Ryu, C. Boutilier, P. Abbeel, M. Ghavamzadeh, K. Lee, and K. Lee · 2023
Later among the works it cites.
Stable bias: Analyzing societal representations in diffusion models
A. S. Luccioni, C. Akiki, M. Mitchell, and Y. Jernite · 2023
Later among the works it cites.
Information Theory: From Coding to Learning
Y. Polyanskiy and Y. Wu · 2023
Later among the works it cites.
Direct preference optimization: Your language model is secretly a reward model
R. Rafailov, A. Sharma, E. Mitchell, C. D. Manning, S. Ermon, and C. Finn · 2023
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Diffusion Schrödinger bridge with applications to score-based generative modeling
V. De Bortoli, J. Thornton, J. Heng, and A. Doucet · 2021
Cited alongside, same era.
Diffusion models beat GANs on image synthesis
P. Dhariwal and A. Nichol · 2021
Cited alongside, same era.
Efficient and accurate gradients for neural SDEs
P. Kidger, J. Foster, X. C. Li, and T. Lyons · 2021
Cited alongside, same era.
Diffwave: A versatile diffusion model for audio synthesis
Z. Kong, W. Ping, J. Huang, K. Zhao, and B. Catanzaro · 2021
Cited alongside, same era.
Score-based generative modeling through stochastic differential equations
Y. Song, J. Sohl-Dickstein, D. P. Kingma, A. Kumar, S. Ermon, and B. Poole · 2021
Cited alongside, same era.
Hierarchical text-conditional image generation with clip latents
A. Ramesh, P. Dhariwal, A. Nichol, C. Chu, and M. Chen · 2022
Cited alongside, same era.
Z. Song, T. Cai, J. D. Lee, and W. J. Su · 2023
Later among the works it cites.
Diffusion model alignment using direct preference optimization
B. Wallace, M. Dang, R. Rafailov, L. Zhou, A. Lou, S. Purushwalkam, S. Ermon, C. Xiong, S. Joty, and N. Naik · 2023
Later among the works it cites.
Training diffusion models with reinforcement learning
K. Black, M. Janner, Y. Du, I. Kostrikov, and S. Levine · 2024
Closest in time.
Sora: Creating video from text
OpenAI · 2024
Closest in time.
Contractive diffusion probabilistic models
W. Tang and H. Zhao · 2024
Closest in time.
Score-based diffusion models via stochastic differential equations–a technical tutorial
W. Tang and H. Zhao · 2024
Closest in time.
Fine-tuning of continuous-time diffusion models as entropy-regularized control
M. Uehara, Y. Zhao, K. Black, E. Hajiramezanali, G. Scalia, N. L. Diamant, A. M. Tseng, T. Biancalani, and S. Levine · 2024
Closest in time.
Beyond reverse KL: Generalizing direct preference optimization with diverse divergence constraints
C. Wang, Y. Jiang, C. Yang, H. Liu, and Y. Chen · 2024
Closest in time.
Score as action: tuning diffusion models by continuous reinforcement learning
H. Zhao, J. Zhang, X. D. Gu, D. D. Yao, and W. Tang · 2024
Closest in time.