Exploring the Potential of Large Language Models for Heterophilic Graphs

Language is all a graph needs

Ruosong Ye, Caiqi Zhang, Runhui Wang, Shuyuan Xu, and Yongfeng Zhang. 2024 · 1973

Earlier work this paper cites.

Social influence analysis in large-scale networks

Jie Tang, Jimeng Sun, Chi Wang, and Zi Yang. 2009 · 2009

Earlier work this paper cites.

Semi-supervised classification with graph convolutional networks

Original

Thomas N Kipf and Max Welling. 2016 · 2016

Earlier work this paper cites.

Inductive representation learning on large graphs

Will Hamilton, Zhitao Ying, and Jure Leskovec. 2017 · 2017

Earlier work this paper cites.

Graph attention networks

Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. 2018 · 2018

Earlier work this paper cites.

Representation learning on graphs with jumping knowledge networks

Keyulu Xu, Chengtao Li, Yonglong Tian, Tomohiro Sonobe, Ken-ichi Kawarabayashi, and Stefanie Jegelka. 2018 · 2018

Earlier work this paper cites.

Mixhop: Higher-order graph convolutional architectures via sparsified neighborhood mixing

Sami Abu-El-Haija, Bryan Perozzi, Amol Kapoor, Nazanin Alipourfard, Kristina Lerman, Hrayr Harutyunyan, Greg Ver Steeg, and Aram Galstyan. 2019 · 2019

Earlier work this paper cites.

Language models are few-shot learners

Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020 · 2020

Earlier work this paper cites.

Geom-gcn: Geometric graph convolutional networks

Hongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei, and Bo Yang. 2020 · 2020

Earlier work this paper cites.

Beyond homophily in graph neural networks: Current limitations and effective designs

Jiong Zhu, Yujun Yan, Lingxiao Zhao, Mark Heimann, Leman Akoglu, and Danai Koutra. 2020 · 2020

Earlier work this paper cites.

Beyond low-frequency information in graph convolutional networks

Deyu Bo, Xiao Wang, Chuan Shi, and Huawei Shen. 2021 · 2021

Earlier work this paper cites.

Adaptive universal generalized pagerank graph neural network

Eli Chien, Jianhao Peng, Pan Li, and Olgica Milenkovic. 2021 · 2021

Earlier work this paper cites.

Node similarity preserving graph convolutional networks

Wei Jin, Tyler Derr, Yiqi Wang, Yao Ma, Zitao Liu, and Jiliang Tang. 2021 · 2021

Earlier work this paper cites.

It’s not just size that matters: Small language models are also few-shot learners

Timo Schick and Hinrich Schütze. 2021 · 2021

Earlier work this paper cites.

Graph neural networks with heterophily

Jiong Zhu, Ryan A Rossi, Anup Rao, Tung Mai, Nedim Lipka, Nesreen K Ahmed, and Danai Koutra. 2021 · 2021

Earlier work this paper cites.

Neural sheaf diffusion: A topological perspective on heterophily and oversmoothing in gnns

Cristian Bodnar, Francesco Di Giovanni, Benjamin Chamberlain, Pietro Lio, and Michael Bronstein. 2022 · 2022

Earlier work this paper cites.

Gbk-gnn: Gated bi-kernel graph neural networks for modeling both homophily and heterophily

Lun Du, Xiaozhou Shi, Qiang Fu, Xiaojun Ma, Hengyu Liu, Shi Han, and Dongmei Zhang. 2022 · 2022

Cited alongside, same era.

Lora: Low-rank adaptation of large language models

Edward J Hu, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen, et al. 2022 · 2022

Cited alongside, same era.

Finding global homophily in graph neural networks when meeting heterophily

Xiang Li, Renyu Zhu, Yao Cheng, Caihua Shan, Siqiang Luo, Dongsheng Li, and Weining Qian. 2022 · 2022

Cited alongside, same era.

Beyond homophily: Structure-aware path aggregation graph neural network

Yifei Sun, Haoran Deng, Yang Yang, Chunping Wang, Jiarong Xu, Renhong Huang, Linfeng Cao, Yang Wang, and Lei Chen. 2022 · 2022

Cited alongside, same era.

Powerful graph convolutional networks with adaptive propagation mechanism for homophily and heterophily

Tao Wang, Di Jin, Rui Wang, Dongxiao He, and Yuxiao Huang. 2022 · 2022

Cited alongside, same era.

Se-gsl: A general and effective graph structure learning framework through structural entropy optimization

Dongcheng Zou, Hao Peng, Xiang Huang, Renyu Yang, Jianxin Li, Jia Wu, Chunyang Liu, and Philip S Yu. 2023 · 2023

Later among the works it cites.

Make heterophilic graphs better fit gnn: A graph rewiring approach

Wendong Bi, Lun Du, Qiang Fu, Yanlin Wang, Shi Han, and Dongmei Zhang. 2024 · 2024

Closest in time.

Exploring the potential of large language models (llms) in learning on graphs

Zhikai Chen, Haitao Mao, Hang Li, Wei Jin, Hongzhi Wen, Xiaochi Wei, Shuaiqiang Wang, Dawei Yin, Wenqi Fan, Hui Liu, et al. 2024 · 2024

Closest in time.

A survey on learning from graphs with heterophily: Recent advances and future directions

Original

Chenghua Gong, Yao Cheng, Jianxiang Yu, Can Xu, Caihua Shan, Siqiang Luo, and Xiang Li. 2024 · 2024

Closest in time.

Minillm: Knowledge distillation of large language models

Yuxian Gu, Li Dong, Furu Wei, and Minlie Huang. 2024 · 2024

Closest in time.