GMLM: Bridging Graph Neural Networks and Language Models for Heterophilic Node Classification

DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

Original

Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2020 · 1910

Earlier work this paper cites.

Graph Transformer Networks

Original

Seongjun Yun, Minbyul Jeong, Raehyun Kim, Jaewoo Kang, and Hyunwoo J. Kim. 2020 · 1911

Earlier work this paper cites.

Node Masking: Making Graph Neural Networks Generalize and Scale Better

Original

Pushkar Mishra, Aleksandra Piktus, Gerard Goossen, and Fabrizio Silvestri. 2021 · 2001

Earlier work this paper cites.

Beyond Homophily in Graph Neural Networks: Current Limitations and Effective Designs. In Advances in Neural Information Processing Systems (NeurIPS)

Original

Jiong Zhu, Yujun Yan, Lingxiao Zhao, Mark Heimann, Leman Akoglu, and Danai Koutra. 2020b · 2006

Earlier work this paper cites.

The Graph Neural Network Model

Franco Scarselli, Marco Gori, Ah Chung Tsoi, Markus Hagenbuchner, and Gabriele Monfardini. 2009 · 2008

Earlier work this paper cites.

Improved Deep Metric Learning with Multi-class N-pair Loss Objective. In Advances in Neural Information Processing Systems , D. Lee, M. Sugiyama, U. Luxburg, I. Guyon, and R. Garnett (Eds.), Vol. 29. Curran Associates, Inc

Kihyuk Sohn. 2016 · 2016

Earlier work this paper cites.

Inductive Representation Learning on Large Graphs. In Advances in Neural Information Processing Systems (NeurIPS)

Original

William L. Hamilton, Rex Ying, and Jure Leskovec. 2017 · 2017

Earlier work this paper cites.

Semi-Supervised Classification with Graph Convolutional Networks

Original

Thomas N. Kipf and Max Welling. 2017 · 2017

Earlier work this paper cites.

Modeling Relational Data with Graph Convolutional Networks

Original

Michael Schlichtkrull, Thomas N. Kipf, Peter Bloem, Rianne van den Berg, Ivan Titov, and Max Welling. 2017 · 2017

Earlier work this paper cites.

Attention is all you need. In Proceedings of the 31st International Conference on Neural Information Processing Systems (Long Beach, California, USA) (NIPS’17) . Curran Associates Inc., Red Hook, NY, USA, 6000–6010

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Earlier work this paper cites.

Graph Attention Networks

Original

Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. 2018 · 2018

Earlier work this paper cites.

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) , Jill Burstein, Christy Doran, and Thamar Solorio (Eds.). Association for Computational Linguistics, Minneapolis, Minnesota, 4171–4186

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019

Earlier work this paper cites.

Fast Graph Representation Learning with PyTorch Geometric. In ICLR Workshop on Representation Learning on Graphs and Manifolds

Matthias Fey and Jan E. Lenssen. 2019 · 2019

Cited alongside, same era.

Decoupled Weight Decay Regularization. In International Conference on Learning Representations

Ilya Loshchilov and Frank Hutter. 2019 · 2019

Cited alongside, same era.

PyTorch: an imperative style, high-performance deep learning library

Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Köpf, Edward Yang, Zach DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019 · 2019

Cited alongside, same era.

GPT-GNN: Generative Pre-Training of Graph Neural Networks. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (Virtual Event, CA, USA) (KDD ’20) . Association for Computing Machinery, New York, NY, USA, 1857–1867

Ziniu Hu, Yuxiao Dong, Kuansan Wang, Kai-Wei Chang, and Yizhou Sun. 2020 · 2020

Cited alongside, same era.

Transformers as Graph-to-Graph Models. In Proceedings of the Big Picture Workshop , Yanai Elazar, Allyson Ettinger, Nora Kassner, Sebastian Ruder, and Noah A. Smith (Eds.). Association for Computational Linguistics, Singapore, 93–107

James Henderson, Alireza Mohammadshahi, Andrei Coman, and Lesly Miculicich. 2023 · 2023

Later among the works it cites.

Attention Is All You Need

Original

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2023 · 2023

Later among the works it cites.

SE-GSL: A General and Effective Graph Structure Learning Framework through Structural Entropy Optimization. In WWW . 499–510

Dongcheng Zou, Hao Peng, Xiang Huang, Renyu Yang, Jianxin Li, Jia Wu, Chunyang Liu, and Philip S. Yu. 2023 · 2023

Later among the works it cites.

A critical look at the evaluation of GNNs under heterophily: Are we really making progress?

Original

Oleg Platonov, Denis Kuznedelev, Michael Diskin, Artem Babenko, and Liudmila Prokhorenkova. 2024 · 2024

Later among the works it cites.