Fetching the paper…
Reading the bibliography…
Despite their competitive performance on knowledge-intensive tasks, large language models (LLMs) still have limitations in memorizing all world knowledge especially long tail knowledge.
Semantic Parsing on Freebase from Question-Answer Pairs. In EMNLP . ACL, 1533–1544
Jonathan Berant, Andrew Chou, Roy Frostig, and Percy Liang. 2013 · 2013
Earlier work this paper cites.
The Value of Semantic Parse Labeling for Knowledge Base Question Answering. In ACL (2) . The Association for Computer Linguistics
Wen-tau Yih, Matthew Richardson, Christopher Meek, Ming-Wei Chang, and Jina Suh. 2016 · 2016
Earlier work this paper cites.
Neural Generative Question Answering. In IJCAI . IJCAI/AAAI Press, 2972–2978
Jun Yin, Xin Jiang, Zhengdong Lu, Lifeng Shang, Hang Li, and Xiaoming Li. 2016 · 2016
Earlier work this paper cites.
Attention is All you Need. In NIPS . 5998–6008
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Earlier work this paper cites.
Deep Graph Convolutional Encoders for Structured Data to Text Generation. In INLG . Association for Computational Linguistics, 1–9
Diego Marcheggiani and Laura Perez-Beltrachini. 2018 · 2018
Earlier work this paper cites.
Object Hallucination in Image Captioning. In EMNLP . Association for Computational Linguistics, 4035–4045
Anna Rohrbach, Lisa Anne Hendricks, Kaylee Burns, Trevor Darrell, and Kate Saenko. 2018 · 2018
Earlier work this paper cites.
The Web as a Knowledge-Base for Answering Complex Questions. In NAACL-HLT . Association for Computational Linguistics, 641–651
Alon Talmor and Jonathan Berant. 2018 · 2018
Earlier work this paper cites.
Graph Attention Networks. In ICLR (Poster) . OpenReview.net
Petar Velickovic, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. 2018 · 2018
Earlier work this paper cites.
Variational Reasoning for Question Answering With Knowledge Graph. In AAAI . AAAI Press, 6069–6076
Yuyu Zhang, Hanjun Dai, Zornitsa Kozareva, Alexander J. Smola, and Le Song. 2018 · 2018
Earlier work this paper cites.
Densely Connected Graph Convolutional Networks for Graph-to-Sequence Learning
Zhijiang Guo, Yan Zhang, Zhiyang Teng, and Wei Lu. 2019 · 2019
Earlier work this paper cites.
Barack’s Wife Hillary: Using Knowledge Graphs for Fact-Aware Language Modeling. In ACL (1) . Association for Computational Linguistics, 5962–5971
Robert L. Logan IV, Nelson F. Liu, Matthew E. Peters, Matt Gardner, and Sameer Singh. 2019 · 2019
Earlier work this paper cites.
Text Generation from Knowledge Graphs with Graph Transformers. In NAACL-HLT (1) . Association for Computational Linguistics, 2284–2293
Rik Koncel-Kedziorski, Dhanush Bekal, Yi Luan, Mirella Lapata, and Hannaneh Hajishirzi. 2019 · 2019
Earlier work this paper cites.
Language Models are Unsupervised Multitask Learners
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019 · 2019
Earlier work this paper cites.
Jie Zhu, Junhui Li, Muhua Zhu, Longhua Qian, Min Zhang, and Guodong Zhou. 2019 · 2019
Earlier work this paper cites.
Graph Transformer for Graph-to-Sequence Learning. In AAAI . AAAI Press, 7464–7471
Deng Cai and Wai Lam. 2020 · 2020
Earlier work this paper cites.
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. In ACL . Association for Computational Linguistics, 7871–7880
Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2020 · 2020
Earlier work this paper cites.
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020 · 2020
Cited alongside, same era.
Improving Multi-hop Question Answering over Knowledge Graphs using Knowledge Base Embeddings. In ACL . Association for Computational Linguistics, 4498–4507
Apoorv Saxena, Aditay Tripathi, and Partha P. Talukdar. 2020 · 2020
Cited alongside, same era.
JointGT: Graph-Text Joint Representation Learning for Text Generation from Knowledge Graphs. In ACL/IJCNLP (Findings) (Findings of ACL, Vol. ACL/IJCNLP 2021) . Association for Computational Linguistics, 2526–2538
Pei Ke, Haozhe Ji, Yu Ran, Xin Cui, Liwei Wang, Linfeng Song, Xiaoyan Zhu, and Minlie Huang. 2021 · 2021
Cited alongside, same era.
Investigating Pretrained Language Models for Graph-to-Text Generation. In Proceedings of the 3rd Workshop on Natural Language Processing for Conversational AI . Association for Computational Linguistics, Online, 211–227
Leonardo F. R. Ribeiro, Martin Schmitt, Hinrich Schütze, and Iryna Gurevych. 2021 · 2021
Cited alongside, same era.
AugGPT: Leveraging ChatGPT for Text Data Augmentation
Haixing Dai, Zhengliang Liu, Wenxiong Liao, Xiaoke Huang, Yihan Cao, Zihao Wu, Lin Zhao, Shaochen Xu, Wei Liu, Ninghao Liu, et al · 2023
Closest in time.
An empirical study of pre-trained language models in simple knowledge graph question answering
Nan Hu, Yike Wu, Guilin Qi, Dehai Min, Jiaoyan Chen, Jeff Z Pan, and Zafar Ali. 2023 · 2023
Closest in time.
Quzhe Huang, Mingxu Tao, Zhenwei An, Chen Zhang, Cong Jiang, Zhibin Chen, Zirui Wu, and Yansong Feng. 2023 · 2023
Closest in time.
Survey of Hallucination in Natural Language Generation
Ziwei Ji, Nayeon Lee, Rita Frieske, Tiezheng Yu, Dan Su, Yan Xu, Etsuko Ishii, Yejin Bang, Andrea Madotto, and Pascale Fung. 2023 · 2023
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
End-to-End Entity Resolution and Question Answering Using Differentiable Knowledge Graphs. In EMNLP (1) . Association for Computational Linguistics, 4193–4200
Amir Saffari, Armin Oliya, Priyanka Sen, and Tom Ayoola. 2021 · 2021
Cited alongside, same era.
Scaling Instruction-Finetuned Language Models
Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, et al · 2022
Cited alongside, same era.
Self-supervised Graph Masking Pre-training for Graph-to-Text Generation. In EMNLP . Association for Computational Linguistics, 4845–4853
Jiuzhou Han and Ehsan Shareghi. 2022 · 2022
Cited alongside, same era.
LoRA: Low-Rank Adaptation of Large Language Models. In ICLR . OpenReview.net
Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2022 · 2022
Cited alongside, same era.
Internet-Augmented Dialogue Generation. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) . Association for Computational Linguistics, Dublin, Ireland, 8460–8478
Mojtaba Komeili, Kurt Shuster, and Jason Weston. 2022 · 2022
Cited alongside, same era.
Rainier: Reinforced Knowledge Introspector for Commonsense Question Answering. In EMNLP . Association for Computational Linguistics, 8938–8958
Jiacheng Liu, Skyler Hallinan, Ximing Lu, Pengfei He, Sean Welleck, Hannaneh Hajishirzi, and Yejin Choi. 2022 · 2022
Cited alongside, same era.
Multitask Prompted Training Enables Zero-Shot Task Generalization. In ICLR . OpenReview.net
Victor Sanh, Albert Webson, Colin Raffel, Stephen H. Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Arun Raja, Manan Dey, et al · 2022
Cited alongside, same era.
Sequence-to-Sequence Knowledge Graph Completion and Question Answering. In ACL (1) . Association for Computational Linguistics, 2814–2828
Apoorv Saxena, Adrian Kochsiek, and Rainer Gemulla. 2022 · 2022
Cited alongside, same era.
Md Tahmid Rahman Laskar, Mizanur Rahman, Israt Jahan, Enamul Hoque, and Jimmy Huang. 2023 · 2023
Closest in time.
Dakuan Lu, Hengkui Wu, Jiaqing Liang, Yipei Xu, Qianyu He, Yipeng Geng, Mengkun Han, Yingsi Xin, and Yanghua Xiao. 2023 · 2023
Closest in time.
When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories. In ACL (1) . Association for Computational Linguistics, 9802–9822
Alex Mallen, Akari Asai, Victor Zhong, Rajarshi Das, Daniel Khashabi, and Hannaneh Hajishirzi. 2023 · 2023
Closest in time.
Linguistic Annotation Generation with ChatGPT: a Synthetic Dataset of Speech Functions for Discourse Annotation of Casual Conversations. In Proceedings of the International Conference “Dialogue , Vol. 2023
Lidiia Ostyakova, Kseniia PetukhovaO, Veronika Smilga, and Dilyara ZharikovaO. 2023 · 2023
Closest in time.
Knowledge Graph-augmented Language Models for Complex Question Answering. In Proceedings of the 1st Workshop on Natural Language Reasoning and Structured Explanations (NLRSE) . Association for Computational Linguistics, Toronto, Canada, 1–8
Priyanka Sen, Sandeep Mavadia, and Amir Saffari. 2023 · 2023
Closest in time.
Evaluation of ChatGPT as a Question Answering System for Answering Complex Questions
Yiming Tan, Dehai Min, Yu Li, Wenbo Li, Nan Hu, Yongrui Chen, and Guilin Qi. 2023 · 2023
Closest in time.
MVP: Multi-task Supervised Pre-training for Natural Language Generation. In ACL (Findings) . Association for Computational Linguistics, 8758–8794
Tianyi Tang, Junyi Li, Wayne Xin Zhao, and Ji-Rong Wen. 2023 · 2023
Closest in time.
LLaMA: Open and Efficient Foundation Language Models
Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, et al · 2023
Closest in time.
Llama 2: Open Foundation and Fine-Tuned Chat Models
Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al · 2023
Closest in time.
Towards Generalist Biomedical AI
Tao Tu, Shekoofeh Azizi, Danny Driess, Mike Schaekermann, Mohamed Amin, Pi-Chuan Chang, Andrew Carroll, Chuck Lau, Ryutaro Tanno, Ira Ktena, et al · 2023
Closest in time.
HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledge
Haochun Wang, Chi Liu, Nuwa Xi, Zewen Qiang, Sendong Zhao, Bing Qin, and Ting Liu. 2023 · 2023
Closest in time.