Fetching the paper…
Reading the bibliography…
Composition optimization is widely-applied in nonconvex machine learning.
A stochastic composite gradient method with incremental variance reduction
Zhang, J. and Xiao, L · 1906
Earlier work this paper cites.
Multi-level composite stochastic optimization via nested variance reduction
Zhang, J. and Xiao, L · 1908
Earlier work this paper cites.
R. tyrell rockafellar, convex analysis (princeton university press, 1970), xviii+ 451 pp
Pryce, J · 1973
Earlier work this paper cites.
Stochastic neighbor embedding
Hinton, G. E. and Roweis, S. T · 2003
Earlier work this paper cites.
Variable selection in nonparametric additive models
Huang, J., Horowitz, J. L., and Wei, F · 2010
Earlier work this paper cites.
A stochastic gradient method with an exponential convergence _rate for finite training sets
Roux, N. L., Schmidt, M., and Bach, F. R · 2012
Earlier work this paper cites.
Accelerating stochastic gradient descent using predictive variance reduction
Johnson, R. and Zhang, T · 2013
Earlier work this paper cites.
Saga: A fast incremental gradient method with support for non-strongly convex composite objectives
Defazio, A., Bach, F., and Lacoste-Julien, S · 2014
Earlier work this paper cites.
Variance reduction for faster non-convex optimization
Allen-Zhu, Z. and Hazan, E · 2016
Earlier work this paper cites.
Finite-sum composition optimization via variance reduced gradient descent
Lian, X., Wang, M., and Liu, J · 2016
Cited alongside, same era.
Accelerating stochastic composition optimization
Wang, M., Liu, J., and Fang, E · 2016
Cited alongside, same era.
Non-convex finite-sum optimization via scsg methods
Lei, L., Ju, C., Chen, J., and Jordan, M. I · 2017
Cited alongside, same era.
Convergence analysis of proximal gradient with momentum for nonconvex optimization
Li, Q., Zhou, Y., Liang, Y., and Varshney, P. K · 2017
Cited alongside, same era.
Variance reduced methods for non-convex composition optimization
Liu, L., Liu, J., and Tao, D · 2017
Cited alongside, same era.
A simple proximal stochastic gradient method for nonsmooth nonconvex optimization
Li, Z. and Li, J · 2018
Later among the works it cites.
Stochastic nested variance reduced gradient descent for nonconvex optimization
Zhou, D., Xu, P., and Gu, Q · 2018
Later among the works it cites.
Finite-sum smooth optimization with sarah
Nguyen, L. M., van Dijk, M., Phan, D. T., Nguyen, P. H., Weng, T.-W., and Kalagnanam, J. R · 2019
Later among the works it cites.
Proxsarah: An efficient algorithmic framework for stochastic composite nonconvex optimization
Pham, N. H., Nguyen, L. M., Phan, D. T., and Tran-Dinh, Q · 2019
Later among the works it cites.
Nonconvex stochastic nested optimization via stochastic admm
Wang, Z · 2019
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Stochastic compositional gradient descent: algorithms for minimizing compositions of expected-value functions
Wang, M., Fang, E. X., and Liu, H · 2017
Cited alongside, same era.
Natasha 2: Faster non-convex optimization than sgd
Allen-Zhu, Z · 2018
Cited alongside, same era.
Spider: Near-optimal non-convex optimization via stochastic path-integrated differential estimator
Fang, C., Li, C. J., Lin, Z., and Zhang, T · 2018
Cited alongside, same era.
Accelerated method for stochastic composition optimization with nonsmooth regularization
Huo, Z., Gu, B., Liu, J., and Huang, H · 2018
Cited alongside, same era.
Katyusha: The first direct acceleration of stochastic gradient methods
Allen-Zhu, Z
Cited in the paper.
Natasha: Faster non-convex stochastic optimization via strongly non-convex parameter
Allen-Zhu, Z
Cited in the paper.
Sarah: A novel method for machine learning problems using stochastic recursive gradient
Nguyen, L. M., Liu, J., Scheinberg, K., and Takáč, M
Cited in the paper.
Spiderboost and momentum: Faster variance reduction algorithms
Wang, Z., Ji, K., Zhou, Y., Liang, Y., and Tarokh, V · 2019
Later among the works it cites.
Katyusha acceleration for convex finite-sum compositional optimization
Xu, Y. and Xu, Y · 2019
Later among the works it cites.
Efficient smooth non-convex stochastic compositional optimization via stochastic recursive gradient descent
Yuan, H., Lian, X., Li, C. J., Liu, J., and Hu, W · 2019
Later among the works it cites.