Fetching the paper…
Reading the bibliography…
Transformers were originally proposed as a sequence-to-sequence model for text but have become vital for a wide range of modalities, including images, audio, video, and undirected graphs.
The art of computer programming, Volume 4, Fascicle 6
Knuth, D. E · 1968
Earlier work this paper cites.
The art of computer programming, Volume 3
Knuth, D. E · 1973
Earlier work this paper cites.
Determinants of Laplacians on graphs
Forman, R · 1993
Earlier work this paper cites.
Discrete Magnetic Laplacian
Shubin, M. A · 1994
Earlier work this paper cites.
The PageRank Citation Ranking : Bringing Order to the Web
Page, L., Brin, S., Motwani, R., and Winograd, T · 1999
Earlier work this paper cites.
The scientist and engineer’s guide to digital signal processing
Smith, S. W · 1999
Earlier work this paper cites.
The Discrete Cosine Transform
Strang, G · 1999
Earlier work this paper cites.
Laplacian Eigenmaps for Dimensionality Reduction and Data Representation
Belkin, M. and Niyogi, P · 2003
Earlier work this paper cites.
Research problems from the Aveiro Workshop on Graph Spectra
Stevanović, D · 2007
Earlier work this paper cites.
A tutorial on spectral clustering
von Luxburg, U · 2007
Earlier work this paper cites.
A Cheeger Inequality for the Graph Connection Laplacian
Bandeira, A. S., Singer, A., and Spielman, D. A · 2013
Earlier work this paper cites.
Nodal count of graph eigenfunctions via magnetic perturbation
Berkolaiko, G · 2013
Earlier work this paper cites.
Magnetic interpretation of the nodal defect on graphs
De Verdière, Y. C · 2013
Earlier work this paper cites.
Discrete Signal Processing on Graphs
Sandryhaila, A. and Moura, J. M. F · 2013
Earlier work this paper cites.
Magnetic eigenmaps for community detection in directed networks, In arXiv , 2016
Fanuel, M., Alaíz, C. M., and Suykens, J. A. K · 2016
Earlier work this paper cites.
Graph Fourier Transform based on Directed Laplacian, In arXiv , 2016
Singh, R., Chakraborty, A., and Manoj, B. S · 2016
Earlier work this paper cites.
Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering
Defferrard, M., Bresson, X., and Vandergheynst, P · 2017
Earlier work this paper cites.
Semi-supervised classification with graph convolutional networks
Kipf, T. N. and Welling, M · 2017
Earlier work this paper cites.
SGDR: Stochastic gradient descent with warm restarts
Loshchilov, I. and Hutter, F · 2017
Earlier work this paper cites.
Attention is all you need
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., and Polosukhin, I · 2017
Earlier work this paper cites.
Learning to Represent Programs with Graphs
Allamanis, M., Brockschmidt, M., and Khademi, M · 2018
Earlier work this paper cites.
Relational inductive biases, deep learning, and graph networks, In arXiv , 2018
Battaglia, P. W., Hamrick, J. B., Bapst, V., Sanchez-Gonzalez, A., Zambaldi, V., Malinowski, M., Tacchetti, A., Raposo, D., Santoro, A., Faulkner, R., Gulcehre, C., Song, F., Ballard, A., Gilmer, J., Dahl, G., Vaswani, A., Allen, K., Nash, C., Langston, V., Dyer, C., Heess, N., Wierstra, D., Kohli, P., Botvinick, M., Vinyals, O., Li, Y., and Pascanu, R · 2018
Earlier work this paper cites.
Magnetic Eigenmaps for the visualization of directed networks
Fanuel, M., Alaíz, C. M., Fernández, A., and Suykens, J. A. K · 2018
Cited alongside, same era.
Attention, Learn to Solve Routing Problems!
Kool, W., Hoof, H. v., and Welling, M · 2019
Cited alongside, same era.
Decoupled Weight Decay Regularization
Loshchilov, I. and Hutter, F · 2019
Cited alongside, same era.
Learning a SAT Solver from Single-Bit Supervision
Selsam, D., Lamm, M., Bünz, B., Liang, P., de Moura, L., and Dill, D. L · 2019
Cited alongside, same era.
Adversarial Robustness for Code
Bielik, P. and Vechev, M · 2020
Cited alongside, same era.
Scaling Graph Neural Networks with Approximate PageRank
Bojchevski, A., Klicpera, J., Perozzi, B., Kapoor, A., Blais, M., Rózemberczki, B., Lukasik, M., and Günnemann, S · 2020
Cited alongside, same era.
Harmonic analysis on directed graphs and applications: from Fourier analysis to wavelets, In arXiv , 2021
Sevi, H., Rilling, G., and Borgnat, P · 2021
Later among the works it cites.
Do Transformers Really Perform Bad for Graph Representation?
Ying, C., Cai, T., Luo, S., Zheng, S., Ke, G., He, D., Shen, Y., and Liu, T.-Y · 2021
Later among the works it cites.
MagNet: A Neural Network for Directed Graphs
Zhang, X., He, Y., Brugnone, N., Perlmutter, M., and Hirn, M · 2021
Later among the works it cites.
A Library for Representing Python Programs as Graphs for Machine Learning, In arXiv , 2022
Bieber, D., Shi, K., Maniatis, P., Sutton, C., Hellendoorn, V., Johnson, D., and Tarlow, D · 2022
Later among the works it cites.
Structure-Aware Transformer for Graph Representation Learning
Chen, D., O’Bray, L., and Borgwardt, K · 2022
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Rethinking Attention with Performers
Choromanski, K. M., Likhosherstov, V., Dohan, D., Song, X., Gane, A., Sarlos, T., Hawkins, P., Davis, J. Q., Mohiuddin, A., Kaiser, L., Belanger, D. B., Colwell, L. J., and Weller, A · 2020
Cited alongside, same era.
ProGraML: Graph-based Deep Learning for Program Optimization and Analysis, In arXiv , 2020
Cummins, C., Fisches, Z. V., Ben-Nun, T., Hoefler, T., and Leather, H · 2020
Cited alongside, same era.
CodeBERT: A Pre-Trained Model for Programming and Natural Languages
Feng, Z., Guo, D., Tang, D., Duan, N., Feng, X., Gong, M., Shou, L., Qin, B., Liu, T., Jiang, D., and Zhou, M · 2020
Cited alongside, same era.
Graph Signal Processing for Directed Graphs Based on the Hermitian Laplacian
Furutani, S., Shibahara, T., Akiyama, M., Hato, K., and Aida, M · 2020
Cited alongside, same era.
Open Graph Benchmark: Datasets for Machine Learning on Graphs
Hu, W., Fey, M., Zitnik, M., Dong, Y., Ren, H., Liu, B., Catasta, M., and Leskovec, J · 2020
Cited alongside, same era.
Reformer: The Efficient Transformer
Kitaev, N., Kaiser, L., and Levskaya, A · 2020
Cited alongside, same era.
Relational Attention: Generalizing Transformers for Graph-Structured Tasks, In arXiv , 2022
Diao, C. and Loynd, R · 2022
Later among the works it cites.
Generalization of Neural Combinatorial Solvers Through the Lens of Adversarial Robustness
Geisler, S., Sommer, J., Schuchardt, J., Bojchevski, A., and Günnemann, S · 2022
Later among the works it cites.
MSGNN: A Spectral Graph Neural Network Based on a Novel Magnetic Signed Laplacian
He, Y., Perlmutter, M., Reinert, G., and Cucuringu, M · 2022
Later among the works it cites.
Global Self-Attention as a Replacement for Graph Convolution
Hussain, M. S., Zaki, M. J., and Subramanian, D · 2022
Later among the works it cites.
CodeAttack: Code-based Adversarial Attacks for Pre-Trained Programming Language Models, In arXiv , 2022
Jha, A. and Reddy, C. K · 2022
Later among the works it cites.
Pure Transformers are Powerful Graph Learners
Kim, J., Nguyen, T. D., Min, S., Cho, S., Lee, M., Lee, H., and Hong, S · 2022
Later among the works it cites.
Competition-Level Code Generation with AlphaCode, In arXiv , 2022
Li, Y., Choi, D., Chung, J., Kushman, N., Schrittwieser, J., Leblond, R., Eccles, T., Keeling, J., Gimeno, F., Lago, A. D., Hubert, T., Choy, P., d’Autume, C. d. M., Babuschkin, I., Chen, X., Huang, P.-S., Welbl, J., Gowal, S., Cherepanov, A., Molloy, J., Mankowitz, D. J., Robson, E. S., Kohli, P., de Freitas, N., Kavukcuoglu, K., and Vinyals, O · 2022
Later among the works it cites.
Sign and Basis Invariant Networks for Spectral Graph Representation Learning, In arXiv , 2022
Lim, D., Robinson, J., Zhao, L., Smidt, T., Sra, S., Maron, H., and Jegelka, S · 2022
Later among the works it cites.
DAGformer: Directed Acyclic Graph Transformer, In arXiv , 2022
Luo, Y · 2022
Later among the works it cites.
Transformer for Graphs: An Overview from Architecture Perspective, In arXiv , 2022
Min, E., Chen, R., Bian, Y., Xu, T., Zhao, K., Huang, W., Zhao, P., Huang, J., Ananiadou, S., and Rong, Y · 2022
Later among the works it cites.
ChatGPT: Optimizing Language Models for Dialogue
OpenAI · 2022
Later among the works it cites.
Semantic Robustness of Models of Source Code
Ramakrishnan, G., Henkel, J., Wang, Z., Albarghouthi, A., Jha, S., and Reps, T · 2022
Later among the works it cites.
Recipe for a General, Powerful, Scalable Graph Transformer
Rampášek, L., Galkin, M., Dwivedi, V. P., Luu, A. T., Wolf, G., and Beaini, D · 2022
Later among the works it cites.
Equivariant and Stable Positional Encoding for More Powerful Graph Neural Networks
Wang, H., Yin, H., Zhang, M., and Li, P · 2022
Later among the works it cites.
NodeFormer: A Scalable Graph Structure Learning Transformer for Node Classification
Wu, Q., Zhao, W., Li, Z., Wipf, D., and Yan, J · 2022
Later among the works it cites.
Attending to Graph Transformers, In arXiv , 2023
Müller, L., Galkin, M., Morris, C., and Rampášek, L · 2023
Closest in time.
Edge Directionality Improves Learning on Heterophilic Graphs, In arXiv , 2023
Rossi, E., Charpentier, B., Di Giovanni, F., Frasca, F., Günnemann, S., and Bronstein, M · 2023
Closest in time.