Fetching the paper…
Reading the bibliography…
The contemporary LLMs are prone to producing hallucinations, stemming mainly from the knowledge gaps within the models.
Language models are few-shot learners
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020 · 1901
Earlier work this paper cites.
Ernie: Enhanced language representation with informative entities
Zhengyan Zhang, Xu Han, Zhiyuan Liu, Xin Jiang, Maosong Sun, and Qun Liu. 2019 · 1905
Earlier work this paper cites.
Barack’s wife hillary: Using knowledge-graphs for fact-aware language modeling
Robert L Logan IV, Nelson F Liu, Matthew E Peters, Matt Gardner, and Sameer Singh. 2019 · 1906
Earlier work this paper cites.
Knowledge enhanced contextual word representations
Matthew E Peters, Mark Neumann, Robert L Logan IV, Roy Schwartz, Vidur Joshi, Sameer Singh, and Noah A Smith. 2019 · 1909
Earlier work this paper cites.
Language models as knowledge bases?
Fabio Petroni, Tim Rocktäschel, Patrick Lewis, Anton Bakhtin, Yuxiang Wu, Alexander H Miller, and Sebastian Riedel. 2019 · 1909
Earlier work this paper cites.
E-bert: Efficient-yet-effective entity embeddings for bert
Nina Poerner, Ulli Waltinger, and Hinrich Schütze. 2019 · 1911
Earlier work this paper cites.
Integrating graph contextualized knowledge into pre-trained language models
Bin He, Di Zhou, Jinghui Xiao, Qun Liu, Nicholas Jing Yuan, Tong Xu, et al. 2019 · 1912
Earlier work this paper cites.
Democratizing reasoning ability: Tailored learning from large language model
Zhaoyang Wang, Shaohan Huang, Yuxuan Liu, Jiahai Wang, Minghui Song, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, et al. 2023c · 1966
Earlier work this paper cites.
A neural probabilistic language model
Yoshua Bengio, Réjean Ducharme, and Pascal Vincent. 2000 · 2000
Earlier work this paper cites.
Exploiting structured knowledge in text via graph-guided representation learning
Tao Shen, Yi Mao, Pengcheng He, Guodong Long, Adam Trischler, and Weizhu Chen. 2020 · 2004
Earlier work this paper cites.
Skep: Sentiment knowledge enhanced pre-training for sentiment analysis
Hao Tian, Can Gao, Xinyan Xiao, Hao Liu, Bolei He, Hua Wu, Haifeng Wang, and Feng Wu. 2020 · 2005
Earlier work this paper cites.
Knowledge-aware language model pretraining
Corby Rosset, Chenyan Xiong, Minh Phan, Xia Song, Paul Bennett, and Saurabh Tiwary. 2020 · 2007
Earlier work this paper cites.
Knowledge graph based synthetic corpus generation for knowledge-enhanced language model pre-training
Oshin Agarwal, Heming Ge, Siamak Shakeri, and Rami Al-Rfou. 2020 · 2010
Earlier work this paper cites.
Introducing the knowledge graph: things, not strings, may 2012
Amit Singhal. 2012 · 2012
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Earlier work this paper cites.
Wikidata: A free collaborative knowledge graph
Knowledge Graphs Seminar, Nahor Gebretensae, and Heiko Paulheim. 2019 · 2019
Earlier work this paper cites.
Why we need knowledge graphs: Applications
Dieter Fensel, Umutcan Şimşek, Kevin Angele, Elwin Huaman, Elias Kärle, Oleksandra Panasiuk, Ioan Toma, Jürgen Umbrich, Alexander Wahler, Dieter Fensel, et al. 2020 · 2020
Earlier work this paper cites.
A survey on knowledge graph-based recommender systems
Qingyu Guo, Fuzhen Zhuang, Chuan Qin, Hengshu Zhu, Xing Xie, Hui Xiong, and Qing He. 2020 · 2020
Earlier work this paper cites.
Retrieval augmented language model pre-training
Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat, and Mingwei Chang. 2020 · 2020
Earlier work this paper cites.
How can we know what language models know?
Zhengbao Jiang, Frank F Xu, Jun Araki, and Graham Neubig. 2020 · 2020
Earlier work this paper cites.
Retrieval-augmented generation for knowledge-intensive nlp tasks
Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al. 2020 · 2020
Earlier work this paper cites.
K-bert: Enabling language representation with knowledge graph
Weijie Liu, Peng Zhou, Zhe Zhao, Zhiruo Wang, Qi Ju, Haotang Deng, and Ping Wang. 2020 · 2020
Earlier work this paper cites.
Knowledge graphs
Aidan Hogan, Eva Blomqvist, Michael Cochez, Claudia d’Amato, Gerard De Melo, Claudio Gutierrez, Sabrina Kirrane, José Emilio Labra Gayo, Roberto Navigli, Sebastian Neumaier, et al. 2021 · 2021
Earlier work this paper cites.
Lora: Low-rank adaptation of large language models
Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021 · 2021
Earlier work this paper cites.
Research on medical question answering system based on knowledge graph
Zhixue Jiang, Chengying Chi, and Yunyun Zhan. 2021 · 2021
Earlier work this paper cites.
Multilingual lama: Investigating knowledge in multilingual pretrained language models
Nora Kassner, Philipp Dufter, and Hinrich Schütze. 2021 · 2021
Earlier work this paper cites.
Jointgt: Graph-text joint representation learning for text generation from knowledge graphs
Pei Ke, Haozhe Ji, Yu Ran, Xin Cui, Liwei Wang, Linfeng Song, Xiaoyan Zhu, and Minlie Huang. 2021 · 2021
Earlier work this paper cites.
Generated knowledge prompting for commonsense reasoning
Jiacheng Liu, Alisa Liu, Ximing Lu, Sean Welleck, Peter West, Ronan Le Bras, Yejin Choi, and Hannaneh Hajishirzi. 2021 · 2021
Earlier work this paper cites.
Zaiqiao Meng, Fangyu Liu, Ehsan Shareghi, Yixuan Su, Charlotte Collins, and Nigel Collier. 2021 · 2021
Earlier work this paper cites.
Scaling language models: Methods, analysis & insights from training gopher
Jack W Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, et al. 2021 · 2021
Earlier work this paper cites.
Interpreting language models through knowledge graph extraction
Vinitra Swamy, Angelika Romanou, and Martin Jaggi. 2021 · 2021
Earlier work this paper cites.
Kepler: A unified model for knowledge embedding and pre-trained language representation
Xiaozhi Wang, Tianyu Gao, Zhaocheng Zhu, Zhengyan Zhang, Zhiyuan Liu, Juanzi Li, and Jian Tang. 2021 · 2021
Earlier work this paper cites.
Knowledge enhanced pretrained language models: A compreshensive survey
Xiaokai Wei, Shen Wang, Dejiao Zhang, Parminder Bhatia, and Andrew Arnold. 2021 · 2021
Earlier work this paper cites.
Building knowledge graphs from unstructured texts: Applications and impact analyses in cybersecurity education
Garima Agrawal, Yuli Deng, Jongchan Park, Huan Liu, and Ying-Chih Chen. 2022 · 2022
Earlier work this paper cites.
A review on language models as knowledge bases
Badr AlKhamissi, Millicent Li, Asli Celikyilmaz, Mona Diab, and Marjan Ghazvininejad. 2022 · 2022
Earlier work this paper cites.
Parishad BehnamGhader, Santiago Miret, and Siva Reddy. 2022 · 2022
Earlier work this paper cites.
Improving language model predictions via prompts enriched with knowledge graphs
Ryan Brate, Minh-Hoang Dang, Fabian Hoppe, Yuan He, Albert Meroño-Peñuela, and Vijay Sadashivaiah. 2022 · 2022
Earlier work this paper cites.
LangChain
Harrison Chase. 2022 · 2022
Earlier work this paper cites.
Knowprompt: Knowledge-aware prompt-tuning with synergistic optimization for relation extraction
Xiang Chen, Ningyu Zhang, Xin Xie, Shumin Deng, Yunzhi Yao, Chuanqi Tan, Fei Huang, Luo Si, and Huajun Chen. 2022 · 2022
Cited alongside, same era.
Binding language models in symbolic languages
Zhoujun Cheng, Tianbao Xie, Peng Shi, Chengzu Li, Rahul Nadkarni, Yushi Hu, Caiming Xiong, Dragomir Radev, Mari Ostendorf, Luke Zettlemoyer, et al. 2022 · 2022
Cited alongside, same era.
Palm: Scaling language modeling with pathways
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, et al. 2022 · 2022
Cited alongside, same era.
Yue Dong, John Wieting, and Pat Verga. 2022 · 2022
Cited alongside, same era.
Critic-driven decoding for mitigating hallucinations in data-to-text generation
Mateusz Lango and Ondřej Dušek. 2023 · 2023
Closest in time.
Getting from generative ai to trustworthy ai: What llms might learn from cyc
Doug Lenat and Gary Marcus. 2023 · 2023
Closest in time.
Few-shot in-context learning for knowledge base question answering
Tianle Li, Xueguang Ma, Alex Zhuang, Yu Gu, Yu Su, and Wenhu Chen. 2023 · 2023
Closest in time.
Mot: Memory-of-thought enables chatgpt to self-improve
Xiaonan Li and Xipeng Qiu. 2023 · 2023
Closest in time.
Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing
Pengfei Liu, Weizhe Yuan, Jinlan Fu, Zhengbao Jiang, Hiroaki Hayashi, and Graham Neubig. 2023 · 2023
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Hangfeng He, Hongming Zhang, and Dan Roth. 2022 · 2022
Cited alongside, same era.
Large language models can self-improve
Jiaxin Huang, Shixiang Shane Gu, Le Hou, Yuexin Wu, Xuezhi Wang, Hongkun Yu, and Jiawei Han. 2022 · 2022
Cited alongside, same era.
Towards reasoning in large language models: A survey
Jie Huang and Kevin Chen-Chuan Chang. 2022 · 2022
Cited alongside, same era.
Knowledge-consistent dialogue generation with knowledge graphs
Minki Kang, Jin Myung Kwak, Jinheon Baek, and Sung Ju Hwang. 2022b · 2022
Cited alongside, same era.
Reasoning over different types of knowledge graphs: Static, temporal and multi-modal
Ke Liang, Lingyuan Meng, Meng Liu, Yue Liu, Wenxuan Tu, Siwei Wang, Sihang Zhou, Xinwang Liu, and Fuchun Sun. 2022 · 2022
Cited alongside, same era.
LlamaIndex
Jerry Liu. 2022 · 2022
Cited alongside, same era.
Dynamic prompt learning via policy gradient for semi-structured mathematical reasoning
Pan Lu, Liang Qiu, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Tanmay Rajpurohit, Peter Clark, and Ashwin Kalyan. 2022 · 2022
Cited alongside, same era.
Financial fraud detection using the related-party transaction knowledge graph
Xuting Mao, Hao Sun, Xiaoqian Zhu, and Jianping Li. 2022 · 2022
Cited alongside, same era.
Linhao Luo, Yuan-Fang Li, Gholamreza Haffari, and Shirui Pan. 2023 · 2023
Closest in time.
When not to trust language models: Investigating effectiveness of parametric and non-parametric memories
Alex Mallen, Akari Asai, Victor Zhong, Rajarshi Das, Daniel Khashabi, and Hannaneh Hajishirzi. 2023 · 2023
Closest in time.
Knowledge injection to counter large language model (llm) hallucination
Ariana Martino, Michael Iannelli, and Coleen Truong. 2023 · 2023
Closest in time.
Augmented language models: a survey
Grégoire Mialon, Roberto Dessì, Maria Lomeli, Christoforos Nalmpantis, Ram Pasunuru, Roberta Raileanu, Baptiste Rozière, Timo Schick, Jane Dwivedi-Yu, Asli Celikyilmaz, et al. 2023 · 2023
Closest in time.
Rethinking language models as symbolic knowledge graphs
Vishwas Mruthyunjaya, Pouya Pezeshkpour, Estevam Hruschka, and Nikita Bhutani. 2023 · 2023
Closest in time.
A review of symbolic, subsymbolic and hybrid methods for sequential decision making
Carlos Núñez-Molina, Pablo Mesejo, and Juan Fernández-Olivares. 2023 · 2023
Closest in time.
A universal question-answering platform for knowledge graphs
Reham Omar, Ishika Dhall, Panos Kalnis, and Essam Mansour. 2023 · 2023
Closest in time.
Can lms learn new entities from descriptions? challenges in propagating injected knowledge
Yasumasa Onoe, Michael JQ Zhang, Shankar Padmanabhan, Greg Durrett, and Eunsol Choi. 2023 · 2023
Closest in time.
OpenAI. 2023 · 2023
Closest in time.
Unifying large language models and knowledge graphs: A roadmap
Shirui Pan, Linhao Luo, Yufei Wang, Chen Chen, Jiapu Wang, and Xindong Wu. 2023 · 2023
Closest in time.
Receval: Evaluating reasoning chains via correctness and informativeness
Archiki Prasad, Swarnadeep Saha, Xiang Zhou, and Mohit Bansal. 2023 · 2023
Closest in time.
In-context retrieval-augmented language models
Ori Ram, Yoav Levine, Itay Dalmedigos, Dor Muhlgay, Amnon Shashua, Kevin Leyton-Brown, and Yoav Shoham. 2023 · 2023
Closest in time.
Nemo guardrails: A toolkit for controllable and safe llm applications with programmable rails
Traian Rebedea, Razvan Dinu, Makesh Sreedhar, Christopher Parisien, and Jonathan Cohen. 2023 · 2023
Closest in time.
Lkpnr: Llm and kg for personalized news recommendation framework
Xie Runfeng, Cui Xiangyang, Yan Zhou, Wang Xin, Xuan Zhanwei, Zhang Kai, et al. 2023 · 2023
Closest in time.
Knowledge graph-augmented language models for complex question answering
Priyanka Sen, Sandeep Mavadia, and Amir Saffari. 2023 · 2023
Closest in time.
Hallucination mitigation in natural language generation from large-scale open-domain knowledge graphs
Xiao Shi, Zhengyuan Zhu, Zeyu Zhang, and Chengkai Li. 2023 · 2023
Closest in time.
Reflexion: an autonomous agent with dynamic memory and self-reflection
Noah Shinn, Beck Labash, and Ashwin Gopinath. 2023 · 2023
Closest in time.
Tree prompting: Efficient task adaptation without fine-tuning
Chandan Singh, John Morris, Alexander M Rush, Jianfeng Gao, and Yuntian Deng. 2023 · 2023
Closest in time.
Evaluating the knowledge base completion potential of gpt
Blerta Veseli, Simon Razniewski, Jan-Christoph Kalo, and Gerhard Weikum. 2023 · 2023
Closest in time.
Explainable claim verification via knowledge-grounded reasoning with large language models
Haoran Wang and Kai Shu. 2023 · 2023
Closest in time.
Kicgpt: Large language model with knowledge in context for knowledge graph completion
Yanbin Wei, Qiushi Huang, Yu Zhang, and James Kwok. 2023 · 2023
Closest in time.
Mindmap: Knowledge graph prompting sparks graph of thoughts in large language models
Yilin Wen, Zifeng Wang, and Jimeng Sun. 2023 · 2023
Closest in time.
Retrieve-rewrite-answer: A kg-to-text enhanced llms framework for knowledge graph question answering
Yike Wu, Nan Hu, Guilin Qi, Sheng Bi, Jie Ren, Anhuan Xie, and Wei Song. 2023 · 2023
Closest in time.
Instructed language models with retrievers are powerful entity linkers
Zilin Xiao, Ming Gong, Jie Wu, Xingyao Zhang, Linjun Shou, and Daxin Jiang. 2023 · 2023
Closest in time.
Prca: Fitting black-box large language models for retrieval question answering via pluggable reward-driven contextual adapter
Haoyan Yang, Zhitao Li, Yong Zhang, Jianzong Wang, Ning Cheng, Ming Li, and Jing Xiao. 2023 · 2023
Closest in time.
Tree of thoughts: Deliberate problem solving with large language models
Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L Griffiths, Yuan Cao, and Karthik Narasimhan. 2023 · 2023
Closest in time.
Alcuna: Large language models meet new knowledge
Xunjian Yin, Baizhou Huang, and Xiaojun Wan. 2023a · 2023
Closest in time.
Exchange-of-thought: Enhancing large language model capabilities through cross-model communication
Zhangyue Yin, Qiushi Sun, Cheng Chang, Qipeng Guo, Junqi Dai, Xuan-Jing Huang, and Xipeng Qiu. 2023b · 2023
Closest in time.
Pre-training language models for comparative reasoning
Mengxia Yu, Zhihan Zhang, Wenhao Yu, and Meng Jiang. 2023 · 2023
Closest in time.
Iag: Induction-augmented generation framework for answering reasoning questions
Zhebin Zhang, Xinyu Zhang, Yuanhang Ren, Saijiang Shi, Meng Han, Yongkang Wu, Ruofei Lai, and Zhao Cao. 2023b · 2023
Closest in time.
How do large language models capture the ever-changing world knowledge? a review of recent advances
Zihan Zhang, Meng Fang, Ling Chen, Mohammad Reza Namazi Rad, and Jun Wang. 2023c · 2023
Closest in time.
Why does chatgpt fall short in answering questions faithfully?
Shen Zheng, Jie Huang, and Kevin Chen-Chuan Chang. 2023 · 2023
Closest in time.