Fetching the paper…
Reading the bibliography…
Transformers have achieved remarkable performance in a myriad of fields including natural language processing and computer vision.
Convolutional networks for images, speech, and time series
Yann LeCun, Yoshua Bengio, et al · 1995
Earlier work this paper cites.
Yanqiao Zhu, Yichen Xu, Feng Yu, Qiang Liu, Shu Wu, and Liang Wang. 2020a · 2006
Earlier work this paper cites.
The graph neural network model
Franco Scarselli, Marco Gori, Ah Chung Tsoi, Markus Hagenbuchner, and Gabriele Monfardini. 2008 · 2008
Earlier work this paper cites.
Spectral networks and locally connected networks on graphs
Joan Bruna, Wojciech Zaremba, Arthur Szlam, and Yann LeCun. 2013 · 2013
Earlier work this paper cites.
Convolutional neural networks on graphs with fast localized spectral filtering
Michaël Defferrard, Xavier Bresson, and Pierre Vandergheynst. 2016a · 2016
Earlier work this paper cites.
Asymmetric Transitivity Preserving Graph Embedding. In KDD
Mingdong Ou, Peng Cui, Jian Pei, Ziwei Zhang, and Wenwu Zhu. 2016 · 2016
Earlier work this paper cites.
Inductive Representation Learning on Large Graphs. In NIPS
William L. Hamilton, Zhitao Ying, and Jure Leskovec. 2017 · 2017
Earlier work this paper cites.
Label informed attributed network embedding. In WSDM
Xiao Huang, Jundong Li, and Xia Hu. 2017 · 2017
Earlier work this paper cites.
Semi-Supervised Classification with Graph Convolutional Networks. In ICLR
Thomas N. Kipf and Max Welling. 2017 · 2017
Earlier work this paper cites.
Attention is All you Need. In NIPS , Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.)
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Earlier work this paper cites.
Deeper insights into graph convolutional networks for semi-supervised learning. In Thirty-Second AAAI conference on artificial intelligence
Qimai Li, Zhichao Han, and Xiao-Ming Wu. 2018 · 2018
Earlier work this paper cites.
Graph Attention Networks. In ICLR
Petar Velickovic, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. 2018 · 2018
Earlier work this paper cites.
Representation learning on graphs with jumping knowledge networks. In International Conference on Machine Learning . PMLR, 5453–5462
Keyulu Xu, Chengtao Li, Yonglong Tian, Tomohiro Sonobe, Ken-ichi Kawarabayashi, and Stefanie Jegelka. 2018 · 2018
Earlier work this paper cites.
Graph Convolutional Neural Networks for Web-Scale Recommender Systems. In KDD
Rex Ying, Ruining He, Kaifeng Chen, Pong Eksombatchai, William L. Hamilton, and Jure Leskovec. 2018 · 2018
Cited alongside, same era.
MixMatch: A Holistic Approach to Semi-Supervised Learning. In NIPS
David Berthelot, Nicholas Carlini, Ian J. Goodfellow, Nicolas Papernot, Avital Oliver, and Colin Raffel. 2019 · 2019
Cited alongside, same era.
Transformer-XL: Attentive Language Models beyond a Fixed-Length Context. In ACL
Zihang Dai, Zhilin Yang, Yiming Yang, Jaime G. Carbonell, Quoc Viet Le, and Ruslan Salakhutdinov. 2019 · 2019
Cited alongside, same era.
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Cited alongside, same era.
Graph Neural Networks for Social Recommendation. In WWW
Wenqi Fan, Yao Ma, Qing Li, Yuan He, Yihong Eric Zhao, Jiliang Tang, and Dawei Yin. 2019 · 2019
Cited alongside, same era.
Graph Random Neural Networks for Semi-Supervised Learning on Graphs. In NIPS
Wenzheng Feng, Jie Zhang, Yuxiao Dong, Yu Han, Huanbo Luan, Qian Xu, Qiang Yang, Evgeny Kharlamov, and Jie Tang. 2020 · 2020
Later among the works it cites.
Investigating and Mitigating Degree-Related Biases in Graph Convolutional Networks. In CIKM
Xianfeng Tang, Huaxiu Yao, Yiwei Sun, Yiqi Wang, Jiliang Tang, Charu Aggarwal, Prasenjit Mitra, and Suhang Wang. 2020 · 2020
Later among the works it cites.
Yiqi Wang, Yao Ma, Charu Aggarwal, and Jiliang Tang. 2020 · 2020
Later among the works it cites.
Big Bird: Transformers for Longer Sequences. In NIPS
Manzil Zaheer, Guru Guruganesh, Kumar Avinava Dubey, Joshua Ainslie, Chris Alberti, Santiago Ontañón, Philip Pham, Anirudh Ravula, Qifan Wang, Li Yang, and Amr Ahmed. 2020 · 2020
Later among the works it cites.
GraphSAINT: Graph Sampling Based Inductive Learning Method. In ICLR
Hanqing Zeng, Hongkuan Zhou, Ajitesh Srivastava, Rajgopal Kannan, and Viktor K. Prasanna. 2020 · 2020
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Predict then Propagate: Graph Neural Networks meet Personalized PageRank. In ICLR
Johannes Klicpera, Aleksandar Bojchevski, and Stephan Günnemann. 2019 · 2019
Cited alongside, same era.
Neural Graph Collaborative Filtering. In SIGIR
Xiang Wang, Xiangnan He, Meng Wang, Fuli Feng, and Tat-Seng Chua. 2019 · 2019
Cited alongside, same era.
A Comprehensive Survey on Graph Neural Networks
Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, and Philip S. Yu. 2019 · 2019
Cited alongside, same era.
How Powerful are Graph Neural Networks?. In ICLR
Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. 2019 · 2019
Cited alongside, same era.
Pairnorm: Tackling oversmoothing in gnns
Lingxiao Zhao and Leman Akoglu. 2019 · 2019
Cited alongside, same era.
Language models are few-shot learners
Tom B Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al · 2020
Cited alongside, same era.
Measuring and Relieving the Over-Smoothing Problem for Graph Neural Networks from the Topological View. In AAAI
Deli Chen, Yankai Lin, Wei Li, Peng Li, Jie Zhou, and Xu Sun. 2020 · 2020
Cited alongside, same era.
Later among the works it cites.
On the Bottleneck of Graph Neural Networks and its Practical Implications. In ICLR
Uri Alon and Eran Yahav. 2021 · 2021
Closest in time.
Accurate Learning of Graph Representations with Graph Multiset Pooling. In ICLR
Jinheon Baek, Minki Kang, and Sung Ju Hwang. 2021 · 2021
Closest in time.
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In ICLR
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, and Neil Houlsby. 2021 · 2021
Closest in time.
A Few More Examples May Be Worth Billions of Parameters
Yuval Kirstain, Patrick Lewis, Sebastian Riedel, and Omer Levy. 2021 · 2021
Closest in time.
Rethinking Graph Transformers with Spectral Attention
Devin Kreuzer, Dominique Beaini, William L. Hamilton, Vincent Létourneau, and Prudencio Tossou. 2021 · 2021
Closest in time.
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo. 2021 · 2021
Closest in time.
Do Transformers Really Perform Bad for Graph Representation?
Chengxuan Ying, Tianle Cai, Shengjie Luo, Shuxin Zheng, Guolin Ke, Di He, Yanming Shen, and Tie-Yan Liu. 2021 · 2021
Closest in time.
Identity-aware Graph Neural Networks. In AAAI
Jiaxuan You, Jonathan M. Gomes-Selman, Rex Ying, and Jure Leskovec. 2021 · 2021
Closest in time.