Fetching the paper…
Reading the bibliography…
The last years have witnessed the emergence of a promising self-supervised learning strategy, referred to as masked autoencoding.
Asymptotic statistics . Vol. 3
Aad W Van der Vaart. 2000 · 2000
Earlier work this paper cites.
Collective classification in network data
Prithviraj Sen, Galileo Namata, Mustafa Bilgic, Lise Getoor, Brian Galligher, and Tina Eliassi-Rad. 2008 · 2008
Earlier work this paper cites.
An Information Theoretic Framework for Multi-view Learning. In Conference on Learning Theory . PMLR
Karthik Sridharan and Sham M. Kakade. 2008 · 2008
Earlier work this paper cites.
Graphical models, exponential families, and variational inference
Martin J Wainwright, Michael I Jordan, et al · 2008
Earlier work this paper cites.
A survey of statistical network models
Anna Goldenberg, Alice X Zheng, Stephen E Fienberg, Edoardo M Airoldi, et al · 2010
Earlier work this paper cites.
DeepWalk: online learning of social representations. In KDD . ACM, 701–710
Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014 · 2014
Earlier work this paper cites.
Lecture notes on information theory
Yury Polyanskiy and Yihong Wu. 2014 · 2014
Earlier work this paper cites.
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. In ICML (JMLR Workshop and Conference Proceedings, Vol. 37) . JMLR.org, 448–456
Sergey Ioffe and Christian Szegedy. 2015 · 2015
Earlier work this paper cites.
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs). In ICLR (Poster)
Djork-Arné Clevert, Thomas Unterthiner, and Sepp Hochreiter. 2016 · 2016
Earlier work this paper cites.
node2vec: Scalable feature learning for networks. In KDD . 855–864
Aditya Grover and Jure Leskovec. 2016 · 2016
Earlier work this paper cites.
Semi-supervised classification with graph convolutional networks
Thomas N Kipf and Max Welling. 2016a · 2016
Earlier work this paper cites.
Variational Graph Auto-Encoders
Thomas N. Kipf and Max Welling. 2016b · 2016
Earlier work this paper cites.
Inductive representation learning on large graphs. In NeurIPS . 1024–1034
Will Hamilton, Zhitao Ying, and Jure Leskovec. 2017 · 2017
Earlier work this paper cites.
Information-theoretic analysis of generalization capability of learning algorithms
Aolin Xu and Maxim Raginsky. 2017 · 2017
Earlier work this paper cites.
Mutual Information Neural Estimation. In ICML , Vol. 80. PMLR, 531–540
Mohamed Ishmael Belghazi, Aristide Baratin, Sai Rajeshwar, Sherjil Ozair, Yoshua Bengio, Aaron Courville, and Devon Hjelm. 2018 · 2018
Earlier work this paper cites.
Adversarially Regularized Graph Autoencoder for Graph Embedding. In IJCAI . ijcai.org, 2609–2615
Shirui Pan, Ruiqi Hu, Guodong Long, Jing Jiang, Lina Yao, and Chengqi Zhang. 2018 · 2018
Earlier work this paper cites.
Pitfalls of Graph Neural Network Evaluation
Oleksandr Shchur, Maximilian Mumme, Aleksandar Bojchevski, and Stephan Günnemann. 2018 · 2018
Earlier work this paper cites.
Graph Attention Networks. In ICLR
Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. 2018 · 2018
Cited alongside, same era.
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL-HLT (1) . Association for Computational Linguistics, 4171–4186
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Cited alongside, same era.
Fast Graph Representation Learning with PyTorch Geometric. In ICLR Workshop on Representation Learning on Graphs and Manifolds
Matthias Fey and Jan E. Lenssen. 2019 · 2019
Cited alongside, same era.
Learning deep representations by mutual information estimation and maximization. In ICLR
R. Devon Hjelm, Alex Fedorov, Samuel Lavoie-Marchildon, Karan Grewal, Philip Bachman, Adam Trischler, and Yoshua Bengio. 2019 · 2019
Cited alongside, same era.
PyTorch: An Imperative Style, High-Performance Deep Learning Library. In NeurIPS . 8024–8035
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Köpf, Edward Z. Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019 · 2019
Understanding Structural Vulnerability in Graph Convolutional Networks. In IJCAI . 2249–2255
Liang Chen, Jintang Li, Qibiao Peng, Yang Liu, Zibin Zheng, and Carl Yang. 2021 · 2021
Later among the works it cites.
Bootstrapped Representation Learning on Graphs. In ICLR 2021 Workshop on Geometrical and Topological Representation Learning
Shantanu Thakoor, Corentin Tallec, Mohammad Gheshlaghi Azar, Remi Munos, Petar Veličković, and Michal Valko. 2021 · 2021
Later among the works it cites.
Self-supervised Learning from a Multi-view Perspective. In ICLR
Yao-Hung Hubert Tsai, Yue Wu, Ruslan Salakhutdinov, and Louis-Philippe Morency. 2021 · 2021
Later among the works it cites.
A Review on Graph Neural Network Methods in Financial Applications
Jianian Wang, Sheng Zhang, Yanghua Xiao, and Rui Song. 2021 · 2021
Later among the works it cites.
Self-supervised learning on graphs: Contrastive, generative, or predictive
Lirong Wu, Haitao Lin, Cheng Tan, Zhangyang Gao, and Stan Z Li. 2021 · 2021
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
On Variational Bounds of Mutual Information. In ICML , Vol. 97. PMLR, 5171–5180
Ben Poole, Sherjil Ozair, Aaron Van Den Oord, Alex Alemi, and George Tucker. 2019 · 2019
Cited alongside, same era.
Deep Graph Infomax
Petar Velickovic, William Fedus, William L Hamilton, Pietro Liò, Yoshua Bengio, and R Devon Hjelm. 2019 · 2019
Cited alongside, same era.
High-dimensional statistics: A non-asymptotic viewpoint . Vol. 48
Martin J Wainwright. 2019 · 2019
Cited alongside, same era.
Generalization and representational limits of graph neural networks. In ICML . PMLR, 3419–3430
Vikas Garg, Stefanie Jegelka, and Tommi Jaakkola. 2020 · 2020
Cited alongside, same era.
Contrastive Multi-View Representation Learning on Graphs. In ICML , Vol. 119. PMLR, 4116–4126
Kaveh Hassani and Amir Hosein Khas Ahmadi. 2020 · 2020
Cited alongside, same era.
Open Graph Benchmark: Datasets for Machine Learning on Graphs
Weihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong, Hongyu Ren, Bowen Liu, Michele Catasta, and Jure Leskovec. 2020 · 2020
Cited alongside, same era.
Graph Representation Learning via Graphical Mutual Information Maximization. In WWW . ACM / IW3C2, 259–270
Zhen Peng, Wenbing Huang, Minnan Luo, Qinghua Zheng, Yu Rong, Tingyang Xu, and Junzhou Huang. 2020 · 2020
Cited alongside, same era.
Later among the works it cites.
SimMIM: A Simple Framework for Masked Image Modeling
Zhenda Xie, Zheng Zhang, Yue Cao, Yutong Lin, Jianmin Bao, Zhuliang Yao, Qi Dai, and Han Hu. 2021 · 2021
Later among the works it cites.
Graph Contrastive Learning Automated. In ICML , Vol. 139. PMLR, 12121–12132
Yuning You, Tianlong Chen, Yang Shen, and Zhangyang Wang. 2021 · 2021
Later among the works it cites.
CSGNN: Contrastive Self-Supervised Graph Neural Network for Molecular Interaction Prediction. In IJCAI . ijcai.org, 3756–3763
Chengshuai Zhao, Shuai Liu, Feng Huang, Shichao Liu, and Wen Zhang. 2021 · 2021
Later among the works it cites.
Masked Autoencoders Are Scalable Vision Learners. In CVPR . IEEE, 15979–15988
Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollár, and Ross B. Girshick. 2022 · 2022
Closest in time.
GraphMAE: Self-Supervised Masked Graph Autoencoders. In KDD . ACM, 594–604
Zhenyu Hou, Xiao Liu, Yukuo Cen, Yuxiao Dong, Hongxia Yang, Chunjie Wang, and Jie Tang. 2022 · 2022
Closest in time.
Augmentation-Free Self-Supervised Learning on Graphs
Namkyeong Lee, Junseok Lee, and Chanyoung Park. 2022 · 2022
Closest in time.
Simple Unsupervised Graph Representation Learning. AAAI
Yujie Mo, Liang Peng, Jie Xu, Xiaoshuang Shi, and Xiaofeng Zhu. 2022 · 2022
Closest in time.
MGAE: Masked Autoencoders for Self-Supervised Learning on Graphs
Qiaoyu Tan, Ninghao Liu, Xiao Huang, Rui Chen, Soo-Hyun Choi, and Xia Hu. 2022 · 2022
Closest in time.
How Mask Matters: Towards Theoretical Understandings of Masked Autoencoders. In NeurIPS
Qi Zhang, Yifei Wang, and Yisen Wang. 2022 · 2022
Closest in time.
Less Can Be More: Unsupervised Graph Pruning for Large-scale Dynamic Graphs
Jintang Li, Sheng Tian, Ruofan Wu, Liang Zhu, Welong Zhao, Changhua Meng, Liang Chen, Zibin Zheng, and Hongzhi Yin. 2023 · 2023
Closest in time.
Graph Contrastive Learning with Adaptive Augmentation. In WWW . ACM / IW3C2, 2069–2080
Yanqiao Zhu, Yichen Xu, Feng Yu, Qiang Liu, Shu Wu, and Liang Wang. 2021 · 2080
Closest in time.