Fetching the paper…
Reading the bibliography…
Text-Attributed Graphs (TAGs) are graphs of connected textual documents.
Language is all a graph needs. In Findings of the Association for Computational Linguistics: EACL 2024 . 1955–1973
Ruosong Ye, Caiqi Zhang, Runhui Wang, Shuyuan Xu, and Yongfeng Zhang. 2024 · 1973
Earlier work this paper cites.
Automating the construction of internet portals with machine learning
Andrew Kachites McCallum, Kamal Nigam, Jason Rennie, and Kristie Seymore. 2000 · 2000
Earlier work this paper cites.
Collective classification in network data
Prithviraj Sen, Galileo Namata, Mustafa Bilgic, Lise Getoor, Brian Galligher, and Tina Eliassi-Rad. 2008 · 2008
Earlier work this paper cites.
Distilling the knowledge in a neural network
Geoffrey Hinton, Oriol Vinyals, and Jeff Dean. 2015 · 2015
Earlier work this paper cites.
Unifying distillation and privileged information
David Lopez-Paz, Léon Bottou, Bernhard Schölkopf, and Vladimir Vapnik. 2015 · 2015
Earlier work this paper cites.
Semi-supervised classification with graph convolutional networks
Thomas N Kipf and Max Welling. 2016 · 2016
Earlier work this paper cites.
Inductive representation learning on large graphs
Will Hamilton, Zhitao Ying, and Jure Leskovec. 2017 · 2017
Earlier work this paper cites.
Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. 2017 · 2017
Earlier work this paper cites.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018 · 2018
Earlier work this paper cites.
Fast Graph Representation Learning with PyTorch Geometric. In ICLR Workshop on Representation Learning on Graphs and Manifolds
Matthias Fey and Jan E. Lenssen. 2019 · 2019
Earlier work this paper cites.
Tinybert: Distilling bert for natural language understanding
Xiaoqi Jiao, Yichun Yin, Lifeng Shang, Xin Jiang, Xiao Chen, Linlin Li, Fang Wang, and Qun Liu. 2019 · 2019
Earlier work this paper cites.
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2019 · 2019
Earlier work this paper cites.
Deberta: Decoding-enhanced bert with disentangled attention
Pengcheng He, Xiaodong Liu, Jianfeng Gao, and Weizhu Chen. 2020 · 2020
Earlier work this paper cites.
Open graph benchmark: Datasets for machine learning on graphs
Weihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong, Hongyu Ren, Bowen Liu, Michele Catasta, and Jure Leskovec. 2020 · 2020
Earlier work this paper cites.
Node feature extraction by self-supervised multi-scale neighborhood prediction
Eli Chien, Wei-Cheng Chang, Cho-Jui Hsieh, Hsiang-Fu Yu, Jiong Zhang, Olgica Milenkovic, and Inderjit S Dhillon. 2021 · 2021
Earlier work this paper cites.
Zero-shot node classification with decomposed graph prototype network. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining . 1769–1779
Zheng Wang, Jialong Wang, Yuchen Guo, and Zhiguo Gong. 2021 · 2021
Cited alongside, same era.
Graph-less neural networks: Teaching old mlps new tricks via distillation
Shichang Zhang, Yozen Liu, Yizhou Sun, and Neil Shah. 2021 · 2021
Cited alongside, same era.
Textgnn: Improving text encoder via graph neural network in sponsored search. In Proceedings of the Web Conference 2021 . 2848–2857
Jason Zhu, Yanling Cui, Yuming Liu, Hao Sun, Xue Li, Markus Pelger, Tianqi Yang, Liangjie Zhang, Ruofei Zhang, and Huasha Zhao. 2021 · 2021
Cited alongside, same era.
Large language models are reasoning teachers
Namgyu Ho, Laura Schmid, and Se-Young Yun. 2022 · 2022
Cited alongside, same era.
Cheng-Yu Hsieh, Chun-Liang Li, Chih-Kuan Yeh, Hootan Nakhost, Yasuhisa Fujii, Alexander Ratner, Ranjay Krishna, Chen-Yu Lee, and Tomas Pfister. 2023 · 2023
Later among the works it cites.
Beyond Text: A Deep Dive into Large Language Models’ Ability on Understanding Graph Data
Yuntong Hu, Zheng Zhang, and Liang Zhao. 2023 · 2023
Later among the works it cites.
Can llms effectively leverage graph structural information: when and why
Jin Huang, Xingjian Zhang, Qiaozhu Mei, and Jiaqi Ma. 2023 · 2023
Later among the works it cites.
Symbolic Chain-of-Thought Distillation: Small Models Can Also" Think" Step-by-Step
Liunian Harold Li, Jack Hessel, Youngjae Yu, Xiang Ren, Kai-Wei Chang, and Yejin Choi. 2023 · 2023
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Shiyang Li, Jianshu Chen, Yelong Shen, Zhiyu Chen, Xinlu Zhang, Zekun Li, Hong Wang, Jing Qian, Baolin Peng, Yi Mao, et al · 2022
Cited alongside, same era.
Teaching small language models to reason
Lucie Charlotte Magister, Jonathan Mallinson, Jakub Adamek, Eric Malmi, and Aliaksei Severyn. 2022 · 2022
Cited alongside, same era.
Knowledge distillation improves graph structure augmentation for graph neural networks
Lirong Wu, Haitao Lin, Yufei Huang, and Stan Z Li. 2022 · 2022
Cited alongside, same era.
Dual Bidirectional Graph Convolutional Networks for Zero-shot Node Classification. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining . 2408–2417
Qin Yue, Jiye Liang, Junbiao Cui, and Liang Bai. 2022 · 2022
Cited alongside, same era.
Learning on large-scale text-attributed graphs via variational inference
Jianan Zhao, Meng Qu, Chaozhuo Li, Hao Yan, Qian Liu, Rui Li, Xing Xie, and Jian Tang. 2022 · 2022
Cited alongside, same era.
Exploring the potential of large language models (llms) in learning on graphs
Zhikai Chen, Haitao Mao, Hang Li, Wei Jin, Hongzhi Wen, Xiaochi Wei, Shuaiqiang Wang, Dawei Yin, Wenqi Fan, Hui Liu, et al · 2023
Cited alongside, same era.
Label-free node classification on graphs with large language models (llms)
Zhikai Chen, Haitao Mao, Hongzhi Wen, Haoyu Han, Wei Jin, Haiyang Zhang, Hui Liu, and Jiliang Tang. 2023b · 2023
Cited alongside, same era.
Cost-effective distillation of large language models. In Findings of the Association for Computational Linguistics: ACL 2023 . 7346–7354
Sayantan Dasgupta, Trevor Cohn, and Timothy Baldwin. 2023 · 2023
Cited alongside, same era.
Distilling reasoning capabilities into smaller language models. In Findings of the Association for Computational Linguistics: ACL 2023 . 7059–7073
Kumar Shridhar, Alessandro Stolfo, and Mrinmaya Sachan. 2023 · 2023
Later among the works it cites.
Large Language Models as Topological Structure Enhancers for Text-Attributed Graphs
Shengyin Sun, Yuxiang Ren, Chen Ma, and Xuecang Zhang. 2023 · 2023
Later among the works it cites.
Graphgpt: Graph instruction tuning for large language models
Jiabin Tang, Yuhao Yang, Wei Wei, Lei Shi, Lixin Su, Suqi Cheng, Dawei Yin, and Chao Huang. 2023 · 2023
Later among the works it cites.
Efficient large language models: A survey
Zhongwei Wan, Xin Wang, Che Liu, Samiul Alam, Yu Zheng, Zhongnan Qu, Shen Yan, Yi Zhu, Quanlu Zhang, Mosharaf Chowdhury, et al · 2023
Later among the works it cites.
A survey on large language model (llm) security and privacy: The good, the bad, and the ugly
Yifan Yao, Jinhao Duan, Kaidi Xu, Yuanfang Cai, Eric Sun, and Yue Zhang. 2023 · 2023
Later among the works it cites.
Visual Attention-Prompted Prediction and Learning
Yifei Zhang, Siyi Gu, Bo Pan, Guangji Bai, Xiaofeng Yang, and Liang Zhao. 2023 · 2023
Later among the works it cites.
Beyond efficiency: A systematic survey of resource-efficient large language models
Guangji Bai, Zheng Chai, Chen Ling, Shiyu Wang, Jiaying Lu, Nan Zhang, Tingwei Shi, Ziyang Yu, Mengdan Zhu, Yifei Zhang, et al · 2024
Closest in time.
LLaGA: Large Language and Graph Assistant
Runjin Chen, Tong Zhao, Ajay Jaiswal, Neil Shah, and Zhangyang Wang. 2024 · 2024
Closest in time.
ELAD: Explanation-Guided Large Language Models Active Distillation
Yifei Zhang, Bo Pan, Chen Ling, Yuntong Hu, and Liang Zhao. 2024b · 2024
Closest in time.
Zheng Zhang, Yuntong Hu, Bo Pan, Chen Ling, and Liang Zhao. 2024a · 2024
Closest in time.
Learning using privileged information: similarity control and knowledge transfer
Vladimir Vapnik, Rauf Izmailov, et al · 2049
Closest in time.