Fetching the paper…
Reading the bibliography…
Stochastic first-order methods such as Stochastic Extragradient (SEG) or Stochastic Gradient Descent-Ascent (SGDA) for solving smooth minimax problems and, more generally, variational inequality problems (VIP) have been gaining a lot of attention in recent years due to the growing popularity of adversarial formulations in machine learning.
A stochastic approximation method
H. Robbins and S. Monro · 1951
Earlier work this paper cites.
Probability inequalities for the sum of independent random variables
G. Bennett · 1962
Earlier work this paper cites.
Numerical methods for finding saddle points
V. F. Dem’yanov and A. B. Pevnyi · 1972
Earlier work this paper cites.
On tail probabilities for martingales
D. A. Freedman et al · 1975
Earlier work this paper cites.
The extragradient method for finding saddle points and other problems
G. M. Korpelevich · 1976
Earlier work this paper cites.
Finite-dimensional variational inequality and nonlinear complementarity problems: a survey of theory, algorithms and applications
P. T. Harker and J.-S. Pang · 1990
Earlier work this paper cites.
On bernstein-type inequalities for martingales
K. Dzhaparidze and J. Van Zanten · 2001
Earlier work this paper cites.
Dual extrapolation and its applications to solving variational inequalities and related problems
Y. Nesterov · 2007
Earlier work this paper cites.
Learning multiple layers of features from tiny images
A. Krizhevsky, G. Hinton, et al · 2009
Earlier work this paper cites.
Robust stochastic approximation approach to stochastic programming
A. Nemirovski, A. Juditsky, G. Lan, and A. Shapiro · 2009
Earlier work this paper cites.
Optimal stochastic approximation algorithms for strongly convex stochastic composite optimization i: A generic algorithmic framework
S. Ghadimi and G. Lan · 2012
Earlier work this paper cites.
Stochastic first-and zeroth-order methods for nonconvex stochastic programming
S. Ghadimi and G. Lan · 2013
Earlier work this paper cites.
On the difficulty of training recurrent neural networks
R. Pascanu, T. Mikolov, and Y. Bengio · 2013
Earlier work this paper cites.
Generative adversarial nets
I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio · 2014
Earlier work this paper cites.
Adam: A method for stochastic optimization
D. P. Kingma and J. Ba · 2014
Earlier work this paper cites.
Hierarchical control using networks trained with higher-level forward models
G. Wayne and L. Abbott · 2014
Earlier work this paper cites.
Beyond convexity: Stochastic quasi-convex optimization
E. Hazan, K. Levy, and S. Shalev-Shwartz · 2015
Earlier work this paper cites.
Improved training of wasserstein gans
I. Gulrajani, F. Ahmed, M. Arjovsky, V. Dumoulin, and A. C. Courville · 2017
Cited alongside, same era.
Gans trained by a two time-scale update rule converge to a local nash equilibrium
M. Heusel, H. Ramsauer, T. Unterthiner, B. Nessler, and S. Hochreiter · 2017
Cited alongside, same era.
Measuring heavy-tailedness of distributions
P. K. Jordanova and M. P. Petkova · 2017
Cited alongside, same era.
Feudal networks for hierarchical reinforcement learning
A. S. Vezhnevets, S. Osindero, T. Schaul, N. Heess, M. Jaderberg, D. Silver, and K. Kavukcuoglu · 2017
Cited alongside, same era.
Spectral normalization for generative adversarial networks
T. Miyato, T. Kataoka, M. Koyama, and Y. Yoshida · 2018
Cited alongside, same era.
Stochastic hamiltonian gradient methods for smooth games
N. Loizou, H. Berard, A. Jolicoeur-Martineau, P. Vincent, S. Lacoste-Julien, and I. Mitliagkas · 2020
Later among the works it cites.
Revisiting stochastic extragradient
K. Mishchenko, D. Kovalev, E. Shulgin, P. Richtarik, and Y. Malitsky · 2020
Later among the works it cites.
Optimistic dual extrapolation for coherent non-monotone variational inequalities
C. Song, Z. Zhou, Y. Zhou, Y. Jiang, and Y. Ma · 2020
Later among the works it cites.
Generalized monotone operators and their averaged resolvents
H. H. Bauschke, W. M. Moursi, and X. Wang · 2021
Later among the works it cites.
High-probability bounds for non-convex stochastic optimization with heavy tails
A. Cutkosky and H. Mehta · 2021
Later among the works it cites.
The complexity of constrained min-max optimization
C. Daskalakis, S. Skoulakis, and M. Zampetakis · 2021
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
J. Abernethy, K. A. Lai, and A. Wibisono · 2019
Cited alongside, same era.
Large scale GAN training for high fidelity natural image synthesis
A. Brock, J. Donahue, and K. Simonyan · 2019
Cited alongside, same era.
On the convergence of single-call stochastic extra-gradient methods
Y.-G. Hsieh, F. Iutzeler, J. Malick, and P. Mertikopoulos · 2019
Cited alongside, same era.
A style-based generator architecture for generative adversarial networks
T. Karras, S. Laine, and T. Aila · 2019
Cited alongside, same era.
Learning in games with continuous action sets and unknown payoff functions
P. Mertikopoulos and Z. Zhou · 2019
Cited alongside, same era.
Algorithms of robust stochastic optimization based on mirror descent method
A. V. Nazin, A. Nemirovsky, A. B. Tsybakov, and A. Juditsky · 2019
Cited alongside, same era.
Self-supervised gan: Analysis and improvement with multi-class minimax game
N.-T. Tran, V.-H. Tran, B.-N. Nguyen, L. Yang, and N.-M. M. Cheung · 2019
Cited alongside, same era.
Later among the works it cites.
From low probability to high confidence in stochastic convex optimization
D. Davis, D. Drusvyatskiy, L. Xiao, and J. Zhang · 2021
Later among the works it cites.
Efficient methods for structured nonconvex-nonconcave min-max optimization
J. Diakonikolas, C. Daskalakis, and M. Jordan · 2021
Later among the works it cites.
E. Gorbunov, M. Danilova, I. Shibaev, P. Dvurechensky, and A. Gasnikov · 2021
Later among the works it cites.
Fast extra gradient methods for smooth structured nonconvex-nonconcave minimax problems
S. Lee and D. Kim · 2021
Later among the works it cites.
Stochastic gradient descent-ascent and consensus optimization for smooth games: Convergence analysis under expected co-coercivity
N. Loizou, H. Berard, G. Gidel, I. Mitliagkas, and S. Lacoste-Julien · 2021
Later among the works it cites.
V. V. Mai and M. Johansson · 2021
Later among the works it cites.
Large-scale convex optimization via monotone operators, 2021
E. K. Ryu and W. Yin · 2021
Later among the works it cites.
Stochastic gradient descent-ascent: Unified theory and new efficient methods
A. Beznosikov, E. Gorbunov, H. Berard, and N. Loizou · 2022
Closest in time.
Solving nonconvex-nonconcave min-max problems exhibiting weak minty solutions
A. Böhm · 2022
Closest in time.
Adam is no better than normalized SGD: Dissecting how adaptivity improves GAN performance, 2022
S. Jelassi, A. Mensch, G. Gidel, and Y. Li · 2022
Closest in time.
Stylegan-xl: Scaling stylegan to large diverse datasets
A. Sauer, K. Schwarz, and A. Geiger · 2022
Closest in time.