Fetching the paper…
Reading the bibliography…
In this work, we propose to employ information-geometric tools to optimize a graph neural network architecture such as the graph convolutional networks.
“Revisiting self-supervised visual representation learning”
Alexander Kolesnikov, Xiaohua Zhai and Lucas Beyer · 1929
Earlier work this paper cites.
“Natural gradient works efficiently in learning”
Shun-Ichi Amari · 1998
Earlier work this paper cites.
“Gradient-based learning applied to document recognition”
Yann LeCun, L“’eon Bottou, Yoshua Bengio and Patrick Haffner · 1998
Earlier work this paper cites.
“The graph neural network model”
Franco Scarselli et al · 2008
Earlier work this paper cites.
“Collective classification in network data”
Prithviraj Sen et al · 2008
Earlier work this paper cites.
“Understanding the difficulty of training deep feedforward neural networks”
Xavier Glorot and Yoshua Bengio · 2010
Earlier work this paper cites.
“Adaptive subgradient methods for online learning and stochastic optimization.”
John Duchi, Elad Hazan and Yoram Singer · 2011
Earlier work this paper cites.
“Imagenet classification with deep convolutional neural networks”
Alex Krizhevsky, Ilya Sutskever and Geoffrey Hinton · 2012
Earlier work this paper cites.
“Adam: A method for stochastic optimization”
Diederik Kingma and Jimmy Ba · 2014
Cited alongside, same era.
“New insights and perspectives on the natural gradient method”
James Martens · 2014
Cited alongside, same era.
“Optimizing neural networks with kronecker-factored approximate curvature”
James Martens and Roger Grosse · 2015
Cited alongside, same era.
“Deep residual learning for image recognition”
Kaiming He, Xiangyu Zhang, Shaoqing Ren and Jian Sun · 2016
Cited alongside, same era.
“Semi-supervised classification with graph convolutional networks”
Thomas Kipf and Max Welling · 2016
Cited alongside, same era.
“Fastgcn: fast learning with graph convolutional networks via importance sampling”
Jie Chen, Tengfei Ma and Cao Xiao · 2018
Later among the works it cites.
“Fast approximate natural gradient descent in a kronecker factored eigenbasis”
Thomas George et al · 2018
Later among the works it cites.
“Cayleynets: Graph convolutional neural networks with complex rational spectral filters”
Ron Levie, Federico Monti, Xavier Bresson and Michael Bronstein · 2018
Later among the works it cites.
“Graph neural networks: A review of methods and applications”
Jie Zhou et al · 2018
Later among the works it cites.
“Fast graph representation learning with PyTorch Geometric”
Matthias Fey and Jan Lenssen · 2019
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
“Revisiting semi-supervised learning with graph embeddings”
Zhilin Yang, William Cohen and Ruslan Salakhudinov · 2016
Cited alongside, same era.
“Geometric deep learning: going beyond euclidean data”
Michael Bronstein et al · 2017
Cited alongside, same era.
“A tutorial on Fisher information”
Alexander Ly et al · 2017
Cited alongside, same era.
“Limitations of the empirical Fisher approximation for natural gradient descent”
Frederik Kunstner, Philipp Hennig and Lukas Balles · 2019
Later among the works it cites.
“Pytorch: An imperative style, high-performance deep learning library”
Adam Paszke et al · 2019
Later among the works it cites.
“A comprehensive survey on graph neural networks”
Zonghan Wu et al · 2020
Closest in time.