Fetching the paper…
Reading the bibliography…
Despite the recent success of Graph Neural Networks (GNNs), it remains challenging to train GNNs on large-scale graphs due to neighbor explosions.
H. Dai, B. Dai, and L. Song, “Discriminative embeddings of latent variable models for structured data,” in International conference on machine learning . PMLR, 2016, pp. 2702–2711
2016
Earlier work this paper cites.
2016
Earlier work this paper cites.
W. Hamilton, Z. Ying, and J. Leskovec, “Inductive representation learning on large graphs,” Advances in neural information processing systems , vol. 30, 2017
2017
Earlier work this paper cites.
R. Ying, R. He, K. Chen, P. Eksombatchai, W. L. Hamilton, and J. Leskovec, “Graph convolutional neural networks for web-scale recommender systems,” in Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining , 2018, pp. 974–983
2018
Earlier work this paper cites.
J. Chen, J. Zhu, and L. Song, “Stochastic training of graph convolutional networks with variance reduction,” in International Conference on Machine Learning . PMLR, 2018, pp. 942–950
2018
Earlier work this paper cites.
K. Lei, M. Qin, B. Bai, G. Zhang, and M. Yang, “Gcn-gan: A non-linear temporal link prediction model for weighted dynamic networks,” in IEEE INFOCOM 2019-IEEE Conference on Computer Communications . IEEE, 2019, pp. 388–396
2019
Earlier work this paper cites.
L. Ma, Z. Yang, Y. Miao, J. Xue, M. Wu, L. Zhou, and Y. Dai, “ { \{ NeuGraph } \} : Parallel deep neural network computation on large graphs,” in 2019 USENIX Annual Technical Conference (USENIX ATC 19) , 2019, pp. 443–458
2019
Earlier work this paper cites.
2019
Earlier work this paper cites.
H. Yang, “Aligraph: A comprehensive graph neural network platform,” in Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining , 2019, pp. 3165–3166
2019
Earlier work this paper cites.
2019
Earlier work this paper cites.
A. Rajeswaran, C. Finn, S. Kakade, and S. Levine, “Meta-learning with implicit gradients,” 2019
2019
Earlier work this paper cites.
2019
Earlier work this paper cites.
W.-L. Chiang, X. Liu, S. Si, Y. Li, S. Bengio, and C.-J. Hsieh, “Cluster-gcn: An efficient algorithm for training deep and large graph convolutional networks,” in Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining , 2019, pp. 257–266
2019
Cited alongside, same era.
2020
Cited alongside, same era.
Z. Jia, S. Lin, M. Gao, M. Zaharia, and A. Aiken, “Improving the accuracy, scalability, and performance of graph neural networks with roc,” Proceedings of Machine Learning and Systems , vol. 2, pp. 187–198, 2020
2020
Cited alongside, same era.
D. Zheng, C. Ma, M. Wang, J. Zhou, Q. Su, X. Song, Q. Gan, Z. Zhang, and G. Karypis, “Distdgl: distributed graph neural network training for billion-scale graphs,” in 2020 IEEE/ACM 10th Workshop on Irregular Applications: Architectures and Algorithms (IA3) . IEEE, 2020, pp. 36–44
V. Md, S. Misra, G. Ma, R. Mohanty, E. Georganas, A. Heinecke, D. Kalamkar, N. K. Ahmed, and S. Avancha, “Distgnn: Scalable distributed training for large-scale graph neural networks,” in Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis , 2021, pp. 1–14
2021
Later among the works it cites.
2021
Later among the works it cites.
2022
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
2020
Cited alongside, same era.
A. Tripathy, K. Yelick, and A. Buluç, “Reducing communication in graph neural network training,” in SC20: International Conference for High Performance Computing, Networking, Storage and Analysis . IEEE, 2020, pp. 1–14
2020
Cited alongside, same era.
W. Hu, M. Fey, M. Zitnik, Y. Dong, H. Ren, B. Liu, M. Catasta, and J. Leskovec, “Open graph benchmark: Datasets for machine learning on graphs,” Advances in neural information processing systems , vol. 33, pp. 22 118–22 133, 2020
2020
Cited alongside, same era.
J. Thorpe, Y. Qiao, J. Eyolfson, S. Teng, G. Hu, Z. Jia, J. Wei, K. Vora, R. Netravali, M. Kim, and G. H. Xu, “Dorylus: Affordable, scalable, and accurate GNN training with distributed CPU servers and serverless threads,” in 15th USENIX Symposium on Operating Systems Design and Implementation (OSDI 21) . USENIX Association, Jul. 2021, pp. 495–514. [Online]. Available: https://www.usenix.org/conference/osdi21/presentation/thorpe
2021
Cited alongside, same era.
2021
Cited alongside, same era.
M. Fey, J. E. Lenssen, F. Weichert, and J. Leskovec, “Gnnautoscale: Scalable and expressive graph neural networks via historical embeddings,” in International Conference on Machine Learning . PMLR, 2021, pp. 3294–3304
2021
Cited alongside, same era.
S. Gandhi and A. P. Iyer, “P3: Distributed deep graph learning at scale,” in 15th { \{ USENIX } \} Symposium on Operating Systems Design and Implementation ( { \{ OSDI } \} 21) , 2021, pp. 551–568
2021
Cited alongside, same era.
Y. Zhang and Q. Yang, “A survey on multi-task learning,” IEEE Transactions on Knowledge and Data Engineering , vol. 34, no. 12, pp. 5586–5609, 2021
2021
Cited alongside, same era.
2022
Later among the works it cites.
H. Yu, L. Wang, B. Wang, M. Liu, T. Yang, and S. Ji, “Graphfm: Improving large-scale gnn training via feature momentum,” in International Conference on Machine Learning . PMLR, 2022, pp. 25 684–25 701
2022
Later among the works it cites.
2022
Later among the works it cites.
L. Wu, P. Cui, J. Pei, L. Zhao, and L. Song, “Graph neural networks,” in Graph Neural Networks: Foundations, Frontiers, and Applications . Springer, 2022, pp. 27–37
2022
Later among the works it cites.
C. Wan, Y. Li, A. Li, N. S. Kim, and Y. Lin, “Bns-gcn: Efficient full-graph training of graph convolutional networks with partition-parallelism and random boundary node sampling,” Proceedings of Machine Learning and Systems , vol. 4, pp. 673–693, 2022
2022
Later among the works it cites.
J. Peng, Z. Chen, Y. Shao, Y. Shen, L. Chen, and J. Cao, “Sancus: sta le n ess-aware c omm u nication-avoiding full-graph decentralized training in large-scale graph neural networks,” Proceedings of the VLDB Endowment , vol. 15, no. 9, pp. 1937–1950, 2022
2022
Later among the works it cites.
A. Xu, Z. Huo, and H. Huang, “On the acceleration of deep learning model parallelism with staleness,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2020, pp. 2088–2097
2097
Closest in time.
Z. Huo, B. Gu, H. Huang et al. , “Decoupled parallel backpropagation with convergence guarantee,” in International Conference on Machine Learning . PMLR, 2018, pp. 2098–2106
2098
Closest in time.