2022

Task-Agnostic Graph Explanations

Xie, Yaochen, Katariya, Sumeet, Tang, Xianfeng et al.

Understand

Graph Neural Networks (GNNs) have emerged as powerful tools to encode graph-structured data.

Due to their broad applications, there is an increasing need to develop tools to explain how GNNs make decisions given graph-structured data.
Existing learning-based GNN explanation approaches are task-specific in training and hence suffer from crucial drawbacks.
Specifically, they are incapable of producing explanations for a multitask prediction model with a single explainer.

Built on

Noise-contrastive estimation: A new estimation principle for unnormalized statistical models
Michael Gutmann and Aapo Hyvärinen · 2010
Earlier work this paper cites.
Comprehensive 3D-QSAR and binding mode of BACE-1 inhibitors using R-group search and molecular docking
Dandan Huang, Yonglan Liu, Bozhi Shi, Yueting Li, Guixue Wang, and Guizhao Liang · 2013
Earlier work this paper cites.
Quantitative structure activity relationship analysis of aminoimidazoles as bace-i inhibitors
Priti Jain and Hemant R. Jadhav · 2013
Earlier work this paper cites.
ZINC 15 – Ligand discovery for everyone
Teague Sterling and John J Irwin · 2015
Earlier work this paper cites.
Variational graph auto-encoders
Original
Thomas N Kipf and Max Welling · 2016
Earlier work this paper cites.
f-GAN: Training generative neural samplers using variational divergence minimization
Sebastian Nowozin, Botond Cseke, and Ryota Tomioka · 2016
Earlier work this paper cites.
Neural message passing for quantum chemistry
Justin Gilmer, Samuel S Schoenholz, Patrick F Riley, Oriol Vinyals, and George E Dahl · 2017
Earlier work this paper cites.
Semi-supervised classification with graph convolutional networks
Thomas N. Kipf and Max Welling · 2017
Earlier work this paper cites.
Learning important features through propagating activation differences
Avanti Shrikumar, Peyton Greenside, and Anshul Kundaje · 2017
Earlier work this paper cites.
Predicting multicellular function through multi-layer tissue networks
Marinka Zitnik and Jure Leskovec · 2017
Earlier work this paper cites.
Graph attention networks
Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio · 2018
Earlier work this paper cites.
MoleculeNet: A benchmark for molecular machine learning
Zhenqin Wu, Bharath Ramsundar, Evan N Feinberg, Joseph Gomes, Caleb Geniesse, Aneesh S Pappu, Karl Leswing, and Vijay Pande · 2018
Earlier work this paper cites.

Similar

Graph convolutional neural networks for web-scale recommender systems
Rex Ying, Ruining He, Kaifeng Chen, Pong Eksombatchai, William L Hamilton, and Jure Leskovec · 2018
Cited alongside, same era.
Graph neural networks for social recommendation
Wenqi Fan, Yao Ma, Qing Li, Yuan He, Eric Zhao, Jiliang Tang, and Dawei Yin · 2019
Cited alongside, same era.
Fast graph representation learning with PyTorch Geometric
Matthias Fey and Jan E. Lenssen · 2019
Cited alongside, same era.
Learning deep representations by mutual information estimation and maximization
R Devon Hjelm, Alex Fedorov, Samuel Lavoie-Marchildon, Karan Grewal, Phil Bachman, Adam Trischler, and Yoshua Bengio · 2019
Cited alongside, same era.
PyTorch: An imperative style, high-performance deep learning library
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala · 2019
Cited alongside, same era.
Explainability methods for graph convolutional neural networks
Phillip E Pope, Soheil Kolouri, Mohammad Rostami, Charles E Martin, and Heiko Hoffmann · 2019
Cited alongside, same era.
Infograph: Unsupervised and semi-supervised graph-level representation learning via mutual information maximization
Fan-Yun Sun, Jordan Hoffman, Vikas Verma, and Jian Tang · 2019
Cited alongside, same era.
Deep graph infomax
Petar Veličković, William Fedus, William L. Hamilton, Pietro Liò, Yoshua Bengio, and Devon Hjelm · 2019
Cited alongside, same era.
How powerful are graph neural networks?
Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka · 2019
Cited alongside, same era.
GNNExplainer: Generating explanations for graph neural networks
Zhitao Ying, Dylan Bourgeois, Jiaxuan You, Marinka Zitnik, and Jure Leskovec · 2019
Cited alongside, same era.
Strategies for pre-training graph neural networks
Weihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik, Percy Liang, Vijay Pande, and Jure Leskovec · 2020
Cited alongside, same era.
Multi-objective molecule generation using interpretable substructures
Wengong Jin, Regina Barzilay, and Tommi Jaakkola · 2020
Cited alongside, same era.

Then

Parameterized explainer for graph neural network
Dongsheng Luo, Wei Cheng, Dongkuan Xu, Wenchao Yu, Bo Zong, Haifeng Chen, and Xiang Zhang · 2020
Later among the works it cites.
Deep graph contrastive representation learning
Yanqiao Zhu, Yichen Xu, Feng Yu, Qiang Liu, Shu Wu, and Liang Wang · 2020
Later among the works it cites.
Generative causal explanations for graph neural networks
Wanyu Lin, Hao Lan, and Baochun Li · 2021
Later among the works it cites.
DIG: A turnkey library for diving into graph deep learning research
Meng Liu, Youzhi Luo, Limei Wang, Yaochen Xie, Hao Yuan, Shurui Gui, Haiyang Yu, Zhao Xu, Jingtun Zhang, Yi Liu, Keqiang Yan, Haoran Liu, Cong Fu, Bora M Oztekin, Xuan Zhang, and Shuiwang Ji · 2021
Later among the works it cites.
GraphDF: A discrete flow model for molecular graph generation
Youzhi Luo, Keqiang Yan, and Shuiwang Ji · 2021
Later among the works it cites.
Towards multi-grained explainability for graph neural networks
Xiang Wang, Yingxin Wu, An Zhang, Xiangnan He, and Tat-Seng Chua · 2021
Later among the works it cites.
On explainability of graph neural networks via subgraph explorations
Hao Yuan, Haiyang Yu, Jie Wang, Kang Li, and Shuiwang Ji · 2021
Later among the works it cites.
Orphicx: A causality-inspired latent variable model for interpreting graph neural networks
Wanyu Lin, Hao Lan, Hao Wang, and Baochun Li · 2022
Closest in time.
Interpretable and generalizable graph learning via stochastic attention mechanism
Siqi Miao, Mia Liu, and Pan Li · 2022
Closest in time.
GraphFM: Improving large-scale GNN training via feature momentum
Haiyang Yu, Limei Wang, Bokun Wang, Meng Liu, Tianbao Yang, and Shuiwang Ji · 2022
Closest in time.
Explainability in graph neural networks: A taxonomic survey
Hao Yuan, Haiyang Yu, Shurui Gui, and Shuiwang Ji · 2022
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…