Diagnosing and Remedying Knowledge Deficiencies in LLMs via Label-free Curricular Meaningful Learning

A mathematical theory of communication

Claude Elwood Shannon. 1948 · 1948

Earlier work this paper cites.

On information and sufficiency

Solomon Kullback and Richard A Leibler. 1951 · 1951

Earlier work this paper cites.

A density-based algorithm for discovering clusters in large spatial databases with noise. In kdd , Vol. 96. 226–231

Martin Ester, Hans-Peter Kriegel, Jörg Sander, Xiaowei Xu, et al · 1996

Earlier work this paper cites.

Visualizing data using t-SNE

Laurens Van der Maaten and Geoffrey Hinton. 2008 · 2008

Earlier work this paper cites.

Curriculum learning. In Proceedings of the 26th annual international conference on machine learning . 41–48

Yoshua Bengio, Jérôme Louradour, Ronan Collobert, and Jason Weston. 2009 · 2009

Earlier work this paper cites.

Choice of plausible alternatives: An evaluation of commonsense causal reasoning. In 2011 AAAI spring symposium series

Melissa Roemmele, Cosmin Adrian Bejan, and Andrew S Gordon. 2011 · 2011

Earlier work this paper cites.

Adam: A method for stochastic optimization

Original

Diederik P Kingma and Jimmy Ba. 2014 · 2014

Earlier work this paper cites.

Think you have solved question answering? try arc, the ai2 reasoning challenge

Original

Peter Clark, Isaac Cowhey, Oren Etzioni, Tushar Khot, Ashish Sabharwal, Carissa Schoenick, and Oyvind Tafjord. 2018 · 2018

Earlier work this paper cites.

Building machines that learn and think like people. In Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems . 5–5

Josh Tenenbaum. 2018 · 2018

Earlier work this paper cites.

Social IQa: Commonsense Reasoning about Social Interactions. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) . 4463–4473

Maarten Sap, Hannah Rashkin, Derek Chen, Ronan Le Bras, and Yejin Choi. 2019 · 2019

Earlier work this paper cites.

CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledge. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) . 4149–4158

Alon Talmor, Jonathan Herzig, Nicholas Lourie, and Jonathan Berant. 2019 · 2019

Earlier work this paper cites.

Abductive Commonsense Reasoning. In International Conference on Learning Representations

Chandra Bhagavatula, Ronan Le Bras, Chaitanya Malaviya, Keisuke Sakaguchi, Ari Holtzman, Hannah Rashkin, Doug Downey, Wen-tau Yih, and Yejin Choi. 2020 · 2020

Earlier work this paper cites.

Genericskb: A knowledge base of generic statements

Original

Sumithra Bhakthavatsalam, Chloe Anastasiades, and Peter Clark. 2020 · 2020

Earlier work this paper cites.

Piqa: Reasoning about physical commonsense in natural language. In Proceedings of the AAAI conference on artificial intelligence , Vol. 34. 7432–7439

Yonatan Bisk, Rowan Zellers, Jianfeng Gao, Yejin Choi, et al · 2020

Earlier work this paper cites.

Training verifiers to solve math word problems

Original

Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, et al · 2021

Earlier work this paper cites.

Did aristotle use a laptop? a question answering benchmark with implicit reasoning strategies

Mor Geva, Daniel Khashabi, Elad Segal, Tushar Khot, Dan Roth, and Jonathan Berant. 2021 · 2021

Earlier work this paper cites.

Measuring Massive Multitask Language Understanding. In International Conference on Learning Representations

Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. 2021 · 2021

Earlier work this paper cites.

e-CARE: a New Dataset for Exploring Explainable Causal Reasoning. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) . 432–446

Li Du, Xiao Ding, Kai Xiong, Ting Liu, and Bing Qin. 2022 · 2022

Earlier work this paper cites.

Crass: A novel data set and benchmark to test counterfactual reasoning of large language models. In Proceedings of the Thirteenth Language Resources and Evaluation Conference . 2126–2140

Jörg Frohberg and Frank Binder. 2022 · 2022

Earlier work this paper cites.

LoRA: Low-Rank Adaptation of Large Language Models. In International Conference on Learning Representations

Edward J Hu, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen, et al · 2022

Earlier work this paper cites.

Maieutic Prompting: Logically Consistent Reasoning with Recursive Explanations. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing . 1266–1279

Jaehun Jung, Lianhui Qin, Sean Welleck, Faeze Brahman, Chandra Bhagavatula, Ronan Le Bras, and Yejin Choi. 2022 · 2022

Earlier work this paper cites.

Chain-of-thought prompting elicits reasoning in large language models

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al · 2022

Earlier work this paper cites.

Gpt-4 technical report

Original

Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al · 2023

Earlier work this paper cites.

Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality

Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E. Gonzalez, Ion Stoica, and Eric P. Xing. 2023 · 2023

Earlier work this paper cites.

Efficient and effective text encoding for chinese llama and alpaca

Original

Yiming Cui, Ziqing Yang, and Xin Yao. 2023 · 2023

Earlier work this paper cites.

Auggpt: Leveraging chatgpt for text data augmentation

Original

Haixing Dai, Zhengliang Liu, Wenxiong Liao, Xiaoke Huang, Yihan Cao, Zihao Wu, Lin Zhao, Shaochen Xu, Wei Liu, Ninghao Liu, et al · 2023

Earlier work this paper cites.

Retrieval-augmented generation for large language models: A survey

Original

Yunfan Gao, Yun Xiong, Xinyu Gao, Kangxiang Jia, Jinliu Pan, Yuxi Bi, Yi Dai, Jiawei Sun, and Haofen Wang. 2023 · 2023

Cited alongside, same era.

Mistral 7B

Original

Albert Q Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, et al · 2023

Cited alongside, same era.

Recexplainer: Aligning large language models for recommendation model interpretability

Original

Yuxuan Lei, Jianxun Lian, Jing Yao, Xu Huang, Defu Lian, and Xing Xie. 2023 · 2023

Cited alongside, same era.

Cmmlu: Measuring massive multitask language understanding in chinese

Original

Haonan Li, Yixuan Zhang, Fajri Koto, Yifei Yang, Hai Zhao, Yeyun Gong, Nan Duan, and Timothy Baldwin. 2023 · 2023

Cited alongside, same era.

Financial statement analysis with large language models

Original

Alex Kim, Maximilian Muhn, and Valeri Nikolaev. 2024b · 2024

Closest in time.

Large Language Models meet Collaborative Filtering: An Efficient All-round LLM-based Recommender System

Original

Sein Kim, Hongseok Kang, Seungyoon Choi, Donghyun Kim, Minchul Yang, and Chanyoung Park. 2024a · 2024

Closest in time.

Biomistral: A collection of open-source pretrained large language models for medical domains

Original

Yanis Labrak, Adrien Bazoge, Emmanuel Morin, Pierre-Antoine Gourraud, Mickael Rouvier, and Richard Dufour. 2024 · 2024

Closest in time.

Llm2llm: Boosting llms with novel iterative data enhancement

Original

Nicholas Lee, Thanakul Wattanawong, Sehoon Kim, Karttikeya Mangalam, Sheng Shen, Gopala Anumanchipali, Michael W Mahoney, Kurt Keutzer, and Amir Gholami. 2024 · 2024

Closest in time.