Fetching the paper…
Reading the bibliography…
Many optimization problems require balancing multiple conflicting objectives.
Some methods of speeding up the convergence of iteration methods
Boris T Polyak · 1964
Earlier work this paper cites.
A method of solving a convex programming problem with convergence rate O(1/k**2)
Yurii Nesterov · 1983
Earlier work this paper cites.
Theory of Multiobjective Optimization
Yoshikazu Sawaragi, Hirotaka Nakayama, and Tetsuzo Tanino · 1985
Earlier work this paper cites.
The Nature of Statistical learning theory
Vladimir Naumovich Vapnik · 1995
Earlier work this paper cites.
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner · 1998
Earlier work this paper cites.
Steepest descent methods for multicriteria optimization
Jörg Fliege and Benar Fux Svaiter · 2000
Earlier work this paper cites.
Convex Optimization
Stephen P Boyd and Lieven Vandenberghe · 2004
Earlier work this paper cites.
Multicriteria Optimization
Matthias Ehrgott · 2005
Earlier work this paper cites.
Multiobjective Optimization: Interactive and Evolutionary Approaches
Jürgen Branke · 2008
Earlier work this paper cites.
Learning multiple layers of features from tiny images, 2009
Alex Krizhevsky, Geoffrey Hinton, et al · 2009
Earlier work this paper cites.
Reading digits in natural images with unsupervised feature learning
Yuval Netzer, Tao Wang, Adam Coates, Alessandro Bissacco, Baolin Wu, Andrew Y Ng, et al · 2011
Earlier work this paper cites.
Multiple-gradient descent algorithm (MGDA) for multiobjective optimization
Jean-Antoine Désidéri · 2012
Earlier work this paper cites.
Generative adversarial nets
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio · 2014
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik P Kingma and Jimmy Ba · 2014
Earlier work this paper cites.
Fast and accurate deep network learning by exponential linear units (ELUs)
Djork-Arné Clevert, Thomas Unterthiner, and Sepp Hochreiter · 2015
Earlier work this paper cites.
Multi-objective optimization
Kalyanmoy Deb, Karthik Sindhya, and Jussi Hakanen · 2016
Earlier work this paper cites.
Incorporating Nesterov momentum into Adam
Timothy Dozat · 2016
Cited alongside, same era.
Domain-adversarial training of neural networks
Yaroslav Ganin, Evgeniya Ustinova, Hana Ajakan, Pascal Germain, Hugo Larochelle, François Laviolette, Mario March, and Victor Lempitsky · 2016
Cited alongside, same era.
Machine learning with adversaries: Byzantine tolerant gradient descent
Peva Blanchard, El Mahdi El Mhamdi, Rachid Guerraoui, and Julien Stainer · 2017
Cited alongside, same era.
Distributed statistical machine learning in adversarial settings: Byzantine gradient descent
Yudong Chen, Lili Su, and Jiaming Xu · 2017
Cited alongside, same era.
Gradient episodic memory for continual learning
David Lopez-Paz and Marc’ Aurelio Ranzato · 2017
Cited alongside, same era.
Descent algorithm for nonsmooth stochastic multiobjective optimization
Fabrice Poirion, Quentin Mercier, and Jean-Antoine Désidéri · 2017
Decoupled weight decay regularization
Ilya Loshchilov and Frank Hutter · 2019
Later among the works it cites.
PyTorch: An imperative style, high-performance deep learning library
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al · 2019
Later among the works it cites.
Just pick a sign: Optimizing deep multitask models with gradient sign dropout
Zhao Chen, Jiquan Ngiam, Yanping Huang, Thang Luong, Henrik Kretzschmar, Yuning Chai, and Dragomir Anguelov · 2020
Later among the works it cites.
Gradient surgery for multi-task learning
Tianhe Yu, Saurabh Kumar, Abhishek Gupta, Sergey Levine, Karol Hausman, and Chelsea Finn · 2020
Later among the works it cites.
Advances and open problems in federated learning
Peter Kairouz, H Brendan McMahan, Brendan Avent, Aurélien Bellet, Mehdi Bennis, Arjun Nitin Bhagoji, Kallista Bonawitz, Zachary Charles, Graham Cormode, Rachel Cummings, et al · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
An overview of multi-task learning in deep neural networks
Sebastian Ruder · 2017
Cited alongside, same era.
Fashion-MNIST: a novel image dataset for benchmarking machine learning algorithms
Han Xiao, Kashif Rasul, and Roland Vollgraf · 2017
Cited alongside, same era.
Deep learning for classical Japanese literature
Tarin Clanuwat, Mikel Bober-Irizar, Asanobu Kitamoto, Alex Lamb, Kazuaki Yamamoto, and David Ha · 2018
Cited alongside, same era.
The hidden vulnerability of distributed learning in Byzantium
Rachid Guerraoui, Sébastien Rouault, et al · 2018
Cited alongside, same era.
A stochastic multiple gradient descent algorithm
Quentin Mercier, Fabrice Poirion, and Jean-Antoine Désidéri · 2018
Cited alongside, same era.
Multi-task learning as multi-objective optimization
Ozan Sener and Vladlen Koltun · 2018
Cited alongside, same era.
Baijiong Lin, Feiyang Ye, Yu Zhang, and Ivor W Tsang · 2021
Later among the works it cites.
In defense of the unitary scalarization for deep multi-task learning
Vitaly Kurin, Alessandro De Palma, Ilya Kostrikov, Shimon Whiteson, and Pawan K Mudigonda · 2022
Later among the works it cites.
Multi-task learning as a bargaining game
Aviv Navon, Aviv Shamsian, Idan Achituve, Haggai Maron, Kenji Kawaguchi, Gal Chechik, and Ethan Fetaya · 2022
Later among the works it cites.
Do current multi-task optimization methods in deep learning even help?
Derrick Xin, Behrooz Ghorbani, Justin Gilmer, Ankush Garg, and Orhan Firat · 2022
Later among the works it cites.
On the convergence of stochastic multi-objective gradient manipulation and beyond
Shiji Zhou, Wenpeng Zhang, Jiyan Jiang, Wenliang Zhong, Jinjie Gu, and Wenwu Zhu · 2022
Later among the works it cites.
Three-way trade-off in multi-objective learning: Optimization, generalization and conflict-avoidance
Lisha Chen, Heshan Fernando, Yiming Ying, and Tianyi Chen · 2023
Later among the works it cites.
Mitigating gradient bias in multi-objective learning: A provably convergent approach
Heshan Devaka Fernando, Han Shen, Miao Liu, Subhajit Chaudhury, Keerthiram Murugesan, and Tianyi Chen · 2023
Later among the works it cites.
Independent component alignment for multi-task learning
Dmitry Senushkin, Nikolay Patakin, Arseny Kuznetsov, and Anton Konushin · 2023
Later among the works it cites.
Direction-oriented multi-objective learning: Simple and provable stochastic algorithms
Peiyao Xiao, Hao Ban, and Kaiyi Ji · 2023
Later among the works it cites.
qpsolvers: Quadratic Programming Solvers in Python, 2024
Stéphane Caron, Daniel Arnström, Suraj Bonagiri, Antoine Dechaume, Nikolai Flowers, Adam Heins, Takuma Ishikawa, Dustin Kenefake, Giacomo Mazzamuto, Donato Meoli, Brendan O’Donoghue, Adam A. Oppenheimer, Abhishek Pandala, Juan José Quiroz Omaña, Nikitas Rontsis, Paarth Shah, Samuel St-Jean, Nicola Vitucci, Soeren Wolfers, Fengyu Yang, @bdelhaisse, @MeindertHH, @rimaddo, @urob, and @shaoanlu · 2024
Closest in time.
The stochastic multi-gradient algorithm for multi-objective optimization and its application to supervised machine learning
Suyun Liu and Luis Nunes Vicente · 2024
Closest in time.