Fetching the paper…
Reading the bibliography…
How can we learn effective node representations on textual graphs? Graph Neural Networks (GNNs) that use Language Models (LMs) to encode textual information of graphs achieve state-of-the-art performance in many node classification tasks.
Zhou, D., Bousquet, O., Lal, T., Weston, J., Schölkopf, B.: Learning with local and global consistency. NIPS (2003)
2003
Earlier work this paper cites.
Ando, R., Zhang, T.: Learning on graph with laplacian regularization. NIPS (2006)
2006
Earlier work this paper cites.
Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. NIPS (2013)
2013
Earlier work this paper cites.
2014
Earlier work this paper cites.
Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. JMLR (2014)
2014
Earlier work this paper cites.
Hinton, G., Vinyals, O., Dean, J., et al.: Distilling the knowledge in a neural network. arXiv (2015)
2015
Earlier work this paper cites.
Gilmer, J., Schoenholz, S.S., Riley, P.F., Vinyals, O., Dahl, G.E.: Neural message passing for quantum chemistry. In: ICML (2017)
2017
Earlier work this paper cites.
Hamilton, W., Ying, Z., Leskovec, J.: Inductive representation learning on large graphs. NeurIPS (2017)
2017
Earlier work this paper cites.
Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: ICLR (2017)
2017
Earlier work this paper cites.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., Polosukhin, I.: Attention is all you need. NIPS (2017)
2017
Earlier work this paper cites.
Schlichtkrull, M., Kipf, T.N., Bloem, P., Berg, R.v.d., Titov, I., Welling, M.: Modeling relational data with graph convolutional networks. In: ESWC (2018)
2018
Earlier work this paper cites.
Veličković, P., Cucurull, G., Casanova, A., Romero, A., Lio, P., Bengio, Y.: Graph attention networks. In: ICLR (2018)
2018
Earlier work this paper cites.
Beltagy, I., Lo, K., Cohan, A.: SciBERT: A pretrained language model for scientific text. In: EMNLP-IJCNLP (2019)
2019
Earlier work this paper cites.
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: BERT: Pre-training of deep bidirectional transformers for language understanding. In: ACL (2019)
2019
Earlier work this paper cites.
Huang, L., Ma, D., Li, S., Zhang, X., Wang, H.: Text level graph neural network for text classification. EMNLP (2019)
2019
Earlier work this paper cites.
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., Stoyanov, V.: Roberta: A robustly optimized bert pretraining approach. arXiv (2019)
2019
Earlier work this paper cites.
Sanh, V., Debut, L., Chaumond, J., Wolf, T.: Distilbert, a distilled version of bert: smaller, faster, cheaper and lighter. arXiv (2019)
2019
Earlier work this paper cites.
Wang, M., Zheng, D., Ye, Z., Gan, Q., Li, M., Song, X., Zhou, J., Ma, C., Yu, L., Gai, Y., et al.: Deep graph library: A graph-centric, highly-performant package for graph neural networks. arXiv (2019)
2019
Earlier work this paper cites.
Yao, L., Mao, C., Luo, Y.: Graph convolutional networks for text classification. In: AAAI (2019)
2019
Cited alongside, same era.
Zeng, H., Zhou, H., Srivastava, A., Kannan, R., Prasanna, V.: Graphsaint: Graph sampling based inductive learning method. arXiv (2019)
2019
Cited alongside, same era.
Zhang, L., Song, J., Gao, A., Chen, J., Bao, C., Ma, K.: Be your own teacher: Improve the performance of convolutional neural networks via self distillation. In: IEEE/CVF ICCV (2019)
2019
Cited alongside, same era.
Hu, W., Fey, M., Zitnik, M., Dong, Y., Ren, H., Liu, B., Catasta, M., Leskovec, J.: Open graph benchmark: Datasets for machine learning on graphs. NeurIPS (2020)
2020
Cited alongside, same era.
Jia, J., Benson, A.R.: Residual correlation in graph neural network regression. In: KDD (2020)
2020
Cited alongside, same era.
Li, G., Müller, M., Ghanem, B., Koltun, V.: Training graph neural networks with 1000 layers. In: ICML (2021)
2021
Later among the works it cites.
Sun, C., Wu, G.: Scalable and adaptive graph neural networks with self-label-enhanced training. arXiv (2021)
2021
Later among the works it cites.
Yang, C., Liu, J., Shi, C.: Extract the knowledge of graph neural networks and go beyond it: An effective knowledge distillation framework. In: WWW (2021)
2021
Later among the works it cites.
Yang, C., Liu, J., Shi, C.: Extract the knowledge of graph neural networks and go beyond it: An effective knowledge distillation framework. In: WWW (2021)
2021
Later among the works it cites.
Yang, H., Ma, K., Cheng, J.: Rethinking graph regularization for graph neural networks. In: AAAI (2021)
2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., Liu, P.J.: Exploring the limits of transfer learning with a unified text-to-text transformer. JMLR (2020)
2020
Cited alongside, same era.
Xu, Y., Zhang, Y., Guo, W., Guo, H., Tang, R., Coates, M.: Graphsail: Graph structure aware incremental learning for recommender systems. In: CIKM (2020)
2020
Cited alongside, same era.
Yan, B., Wang, C., Guo, G., Lou, Y.: Tinygnn: Learning efficient graph neural networks. In: KDD (2020)
2020
Cited alongside, same era.
Yang, Y., Qiu, J., Song, M., Tao, D., Wang, X.: Distilling knowledge from graph convolutional networks. In: IEEE/CVF CVPR (2020)
2020
Cited alongside, same era.
Yuan, L., Tay, F.E., Li, G., Wang, T., Feng, J.: Revisiting knowledge distillation via label smoothing regularization. In: IEEE/CVF CVPR (2020)
2020
Cited alongside, same era.
Zhang, J., Zhang, H., Xia, C., Sun, L.: Graph-bert: Only attention is needed for learning graph representations. arXiv (2020)
2020
Cited alongside, same era.
Zhang, W., Deng, L., Zhang, L., Wu, D.: A survey on negative transfer. arXiv (2020)
2020
Cited alongside, same era.
Yang, J., Liu, Z., Xiao, S., Li, C., Lian, D., Agrawal, S., Singh, A., Sun, G., Xie, X.: Graphformers: Gnn-nested transformers for representation learning on textual graph. NeurIPS (2021)
2021
Later among the works it cites.
2021
Later among the works it cites.
Chien, E., Chang, W.C., Hsieh, C.J., Yu, H.F., Zhang, J., Milenkovic, O., Dhillon, I.S.: Node feature extraction by self-supervised multi-scale neighborhood prediction. In: ICLR (2022)
2022
Later among the works it cites.
Dinh, T.A., Boef, J.d., Cornelisse, J., Groth, P.: E2EG: End-to-end node classification using graph topology and text-based node attributes. arXiv (2022)
2022
Later among the works it cites.
Dong, W., Wu, J., Luo, Y., Ge, Z., Wang, P.: Node representation learning in graph via node-to-neighbourhood mutual information maximization. In: IEEE/CVF CVPR (2022)
2022
Later among the works it cites.
Ioannidis, V.N., Song, X., Zheng, D., Zhang, H., Ma, J., Xu, Y., Zeng, B., Chilimbi, T., Karypis, G.: Efficient and effective training of language and graph neural network models. arXiv (2022)
2022
Later among the works it cites.
Mavromatis, C., Karypis, G.: ReaRev: Adaptive reasoning for question answering over knowledge graphs. arXiv (2022)
2022
Later among the works it cites.
Yasunaga, M., Bosselut, A., Ren, H., Zhang, X., Manning, C.D., Liang, P., Leskovec, J.: Deep bidirectional language-knowledge graph pretraining. NeurIPS (2022)
2022
Later among the works it cites.
Yasunaga, M., Leskovec, J., Liang, P.: Linkbert: Pretraining language models with document links. ACL (2022)
2022
Later among the works it cites.
Zhang, S., Liu, Y., Sun, Y., Shah, N.: Graph-less neural networks: Teaching old MLPs new tricks via distillation. In: ICLR (2022)
2022
Later among the works it cites.
Zhang, X., Bosselut, A., Yasunaga, M., Ren, H., Liang, P., Manning, C.D., Leskovec, J.: GreaseLM: Graph REASoning enhanced language models. In: ICLR (2022)
2022
Later among the works it cites.
Zhao, J., Qu, M., Li, C., Yan, H., Liu, Q., Li, R., Xie, X., Tang, J.: Learning on large-scale text-attributed graphs via variational inference. arXiv (2022)
2022
Later among the works it cites.
Zheng, W., Huang, E.W., Rao, N., Katariya, S., Wang, Z., Subbian, K.: Cold brew: Distilling graph node representations with incomplete or missing neighborhoods. ICLR (2022)
2022
Later among the works it cites.