Fetching the paper…
Reading the bibliography…
In this paper, we study the challenging task of Byzantine-robust decentralized training on arbitrary communication graphs.
Bridge: Byzantine-resilient decentralized gradient descent
Zhixiong Yang and Waheed U Bajwa · 1908
Earlier work this paper cites.
Monte carlo sampling methods using markov chains and their applications
W Keith Hastings · 1970
Earlier work this paper cites.
Reaching agreement in the presence of faults
Marshall C. Pease, Robert E. Shostak, and Leslie Lamport · 1980
Earlier work this paper cites.
Authenticated algorithms for byzantine agreement
Danny Dolev and H. Raymond Strong · 1983
Earlier work this paper cites.
Easy impossibility proofs for distributed consensus problems
Michael J Fischer, Nancy A Lynch, and Michael Merritt · 1986
Earlier work this paper cites.
Collective dynamics of ‘small-world’networks
Duncan J Watts and Steven H Strogatz · 1998
Earlier work this paper cites.
Randomized gossip algorithms
Stephen Boyd, Arpita Ghosh, Balaji Prabhakar, and Devavrat Shah · 2006
Earlier work this paper cites.
Exploring network structure, dynamics, and function using networkx
Aric Hagberg, Pieter Swart, and Daniel S Chult · 2008
Earlier work this paper cites.
Learning multiple layers of features from tiny images
Alex Krizhevsky, Geoffrey Hinton, et al · 2009
Earlier work this paper cites.
MNIST handwritten digit database
Yann LeCun and Corinna Cortes · 2010
Earlier work this paper cites.
Resilient asymptotic consensus in robust networks
Heath J LeBlanc, Haotian Zhang, Xenofon Koutsoukos, and Shreyas Sundaram · 2013
Earlier work this paper cites.
Multi-valued byzantine broadcast: The t < n case
Martin Hirt and Pavel Raykov · 2014
Earlier work this paper cites.
Very deep convolutional networks for large-scale image recognition
Karen Simonyan and Andrew Zisserman · 2014
Earlier work this paper cites.
Multi-agent optimization in the presence of byzantine adversaries: Fundamental limits
Lili Su and Nitin Vaidya · 2016
Earlier work this paper cites.
Machine learning with adversaries: Byzantine tolerant gradient descent
Peva Blanchard, El Mahdi El Mhamdi, Rachid Guerraoui, and Julien Stainer · 2017
Earlier work this paper cites.
Proof-of-personhood: Redemocratizing permissionless cryptocurrencies
Maria Borge, Eleftherios Kokoris-Kogias, Philipp Jovanovic, Linus Gasser, Nicolas Gailly, and Bryan Ford · 2017
Earlier work this paper cites.
Distributed statistical machine learning in adversarial settings: Byzantine gradient descent
Yudong Chen, Lili Su, and Jiaming Xu · 2017
Earlier work this paper cites.
Can decentralized algorithms outperform centralized algorithms? a case study for decentralized parallel stochastic gradient descent, 2017
Xiangru Lian, Ce Zhang, Huan Zhang, Cho-Jui Hsieh, Wei Zhang, and Ji Liu · 2017
Earlier work this paper cites.
Communication-efficient learning of deep networks from decentralized data
Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Agüera y Arcas · 2017
Earlier work this paper cites.
Byzantine stochastic gradient descent
Dan Alistarh, Zeyuan Allen-Zhu, and Jerry Li · 2018
Earlier work this paper cites.
DRACO: byzantine-resilient distributed training via redundant gradients
Lingjiao Chen, Hongyi Wang, Zachary B. Charles, and Dimitris S. Papailiopoulos · 2018
Earlier work this paper cites.
Asynchronous byzantine machine learning (the case of SGD)
Georgios Damaskinos, El Mahdi El Mhamdi, Rachid Guerraoui, Rhicheek Patra, and Mahsa Taziki · 2018
Earlier work this paper cites.
The hidden vulnerability of distributed learning in byzantium
El Mahdi El Mhamdi, Rachid Guerraoui, and Sébastien Rouault · 2018
Earlier work this paper cites.
Distributed optimization under adversarial nodes
Shreyas Sundaram and Bahman Gharesifard · 2018
Earlier work this paper cites.
D 2 : Decentralized training over decentralized data, 2018
Hanlin Tang, Xiangru Lian, Ming Yan, Ce Zhang, and Ji Liu · 2018
Cited alongside, same era.
Generalized byzantine-tolerant sgd
Cong Xie, Oluwasanmi Koyejo, and Indranil Gupta · 2018
Cited alongside, same era.
Byzantine-robust distributed learning: Towards optimal statistical rates
Dong Yin, Yudong Chen, Kannan Ramchandran, and Peter L. Bartlett · 2018
Cited alongside, same era.
Stochastic gradient push for distributed deep learning, 2019
Mahmoud Assran, Nicolas Loizou, Nicolas Ballas, and Michael Rabbat · 2019
Cited alongside, same era.
A little is enough: Circumventing defenses for distributed learning
Gilad Baruch, Moran Baruch, and Yoav Goldberg · 2019
Cited alongside, same era.
signsgd with majority vote is communication efficient and fault tolerant, 2019
Jeremy Bernstein, Jiawei Zhao, Kamyar Azizzadenesheli, and Anima Anandkumar · 2019
Practical low-rank communication compression in decentralized deep learning
Thijs Vogels, Sai Praneeth Karimireddy, and Martin Jaggi · 2020
Later among the works it cites.
Zeno++: Robust fully asynchronous SGD
Cong Xie, Sanmi Koyejo, and Indranil Gupta · 2020
Later among the works it cites.
Election coding for distributed learning: Protecting signsgd against byzantine attacks, 2020
Jy yong Sohn, Dong-Jun Han, Beongjun Choi, and Jaekyun Moon · 2020
Later among the works it cites.
Byzantine-resilient non-convex stochastic gradient descent
Zeyuan Allen-Zhu, Faeze Ebrahimianghazani, Jerry Li, and Dan Alistarh · 2021
Later among the works it cites.
Aggregation over metric spaces: Proposing and voting in elections, budgeting, and legislation
Laurent Bulteau, Gal Shahaf, Ehud Shapiro, and Nimrod Talmon · 2021
Later among the works it cites.
Rofl: Attestable robustness for secure federated learning, 2021
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Advances and open problems in federated learning
Peter Kairouz, H. Brendan McMahan, Brendan Avent, Aurélien Bellet, Mehdi Bennis, Arjun Nitin Bhagoji, Keith Bonawitz, Zachary Charles, Graham Cormode, Rachel Cummings, Rafael G. L. D’Oliveira, Salim El Rouayheb, David Evans, Josh Gardner, Zachary Garrett, Adrià Gascón, Badih Ghazi, Phillip B. Gibbons, Marco Gruteser, Zaïd Harchaoui, Chaoyang He, Lie He, Zhouyuan Huo, Ben Hutchinson, Justin Hsu, Martin Jaggi, Tara Javidi, Gauri Joshi, Mikhail Khodak, Jakub Konecný, Aleksandra Korolova, Farinaz Koushanfar, Sanmi Koyejo, Tancrède Lepoint, Yang Liu, Prateek Mittal, Mehryar Mohri, Richard Nock, Ayfer Özgür, Rasmus Pagh, Mariana Raykova, Hang Qi, Daniel Ramage, Ramesh Raskar, Dawn Song, Weikang Song, Sebastian U. Stich, Ziteng Sun, Ananda Theertha Suresh, Florian Tramèr, Praneeth Vepakomma, Jianyu Wang, Li Xiong, Zheng Xu, Qiang Yang, Felix X. Yu, Han Yu, and Sen Zhao · 2019
Cited alongside, same era.
Decentralized stochastic optimization and gossip algorithms with compressed communication, 2019
Anastasia Koloskova, Sebastian U. Stich, and Martin Jaggi · 2019
Cited alongside, same era.
The byzantine generals problem
Leslie Lamport, Robert Shostak, and Marshall Pease · 2019
Cited alongside, same era.
RSA: byzantine-robust stochastic aggregation methods for distributed learning from heterogeneous datasets
Liping Li, Wei Xu, Tianyi Chen, Georgios B. Giannakis, and Qing Ling · 2019
Cited alongside, same era.
Pytorch: An imperative style, high-performance deep learning library
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Köpf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala · 2019
Cited alongside, same era.
Robust aggregation for federated learning
Krishna Pillutla, Sham M Kakade, and Zaid Harchaoui · 2019
Cited alongside, same era.
Lukas Burkhalter, Hidde Lycklama, Alexander Viand, Nicolas Küchler, and Anwar Hithnawi · 2021
Later among the works it cites.
Byzantine-resilient sgd in high dimensions on heterogeneous data
Deepesh Data and Suhas Diggavi · 2021
Later among the works it cites.
Collaborative learning in the jungle (decentralized, byzantine, heterogeneous, asynchronous and nonconvex learning)
El Mahdi El-Mhamdi, Sadegh Farhadkhani, Rachid Guerraoui, Arsany Guirguis, Lê-Nguyên Hoang, and Sébastien Rouault · 2021
Later among the works it cites.
Distributed momentum for byzantine-resilient stochastic gradient descent
El Mahdi El Mhamdi, Rachid Guerraoui, and Sébastien Louis Alexandre Rouault · 2021
Later among the works it cites.
10. technologizing democracy or democratizing technology? a layered-architecture perspective on potentials and challenges
Bryan Ford · 2021
Later among the works it cites.
Secure distributed training at scale, 2021
Eduard Gorbunov, Alexander Borzunov, Michael Diskin, and Max Ryabinin · 2021
Later among the works it cites.
Byzantine-resilient decentralized stochastic gradient descent, 2021
Shangwei Guo, Tianwei Zhang, Han Yu, Xiaofei Xie, Lei Ma, Tao Xiang, and Yang Liu · 2021
Later among the works it cites.
Byzantine fault-tolerance in federated local sgd under 2f-redundancy
Nirupam Gupta, Thinh T Doan, and Nitin Vaidya · 2021
Later among the works it cites.
Learning from history for byzantine robust optimization
Sai Praneeth Karimireddy, Lie He, and Martin Jaggi · 2021
Later among the works it cites.
An improved analysis of gradient tracking for decentralized machine learning
Anastasiia Koloskova, Tao Lin, and Sebastian U Stich · 2021
Later among the works it cites.
Consensus control for decentralized deep learning
Lingjing Kong, Tao Lin, Anastasia Koloskova, Martin Jaggi, and Sebastian U Stich · 2021
Later among the works it cites.
A linearly convergent algorithm for decentralized optimization: Sending less bits for free!
Dmitry Kovalev, Anastasia Koloskova, Martin Jaggi, Peter Richtarik, and Sebastian Stich · 2021
Later among the works it cites.
Communication-efficient local decentralized sgd methods, 2021
Xiang Li, Wenhao Yang, Shusen Wang, and Zhihua Zhang · 2021
Later among the works it cites.
Quasi-global momentum: Accelerating decentralized deep learning on heterogeneous data
Tao Lin, Sai Praneeth Karimireddy, Sebastian U Stich, and Martin Jaggi · 2021
Later among the works it cites.
Building a sybil-resilient digital community utilizing trust-graph connectivity
Ouri Poupko, Gal Shahaf, Ehud Shapiro, and Nimrod Talmon · 2021
Later among the works it cites.
Relaysum for decentralized deep learning on heterogeneous data, 2021
Thijs Vogels, Lie He, Anastasia Koloskova, Tao Lin, Sai Praneeth Karimireddy, Sebastian U. Stich, and Martin Jaggi · 2021
Later among the works it cites.
BASGD: buffered asynchronous SGD for byzantine learning
Yi-Rui Yang and Wu-Jun Li · 2021
Later among the works it cites.
Decentlam: Decentralized momentum sgd for large-batch deep training
Kun Yuan, Yiming Chen, Xinmeng Huang, Yingya Zhang, Pan Pan, Yinghui Xu, and Wotao Yin · 2021
Later among the works it cites.