Strategic Data Ordering: Enhancing Large Language Model Performance through Curriculum Learning

Competence-based curriculum learning for neural machine translation

Emmanouil Antonios Platanios, Otilia Stretcu, Graham Neubig, Barnabás Póczos, and Tom M Mitchell. 2019 · 1903

Earlier work this paper cites.

Simple and effective curriculum pointer-generator networks for reading comprehension over long narratives

Original

Yi Tay, Shuohang Wang, Luu Anh Tuan, Jie Fu, Minh C Phan, Xingdi Yuan, Jinfeng Rao, Siu Cheung Hui, and Aston Zhang. 2019 · 1905

Earlier work this paper cites.

Hellaswag: Can a machine really finish your sentence?

Original

Rowan Zellers, Ari Holtzman, Yonatan Bisk, Ali Farhadi, and Yejin Choi. 2019 · 1905

Earlier work this paper cites.

Scaling laws for neural language models

Original

Jared Kaplan, Sam McCandlish, Tom Henighan, Tom B Brown, Benjamin Chess, Rewon Child, Scott Gray, Alec Radford, Jeffrey Wu, and Dario Amodei. 2020 · 2001

Earlier work this paper cites.

Curriculum learning

Yoshua Bengio, Jérôme Louradour, Ronan Collobert, and Jason Weston. 2009 · 2009

Earlier work this paper cites.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Earlier work this paper cites.

Think you have solved question answering? try arc, the ai2 reasoning challenge

Original

Peter Clark, Isaac Cowhey, Oren Etzioni, Tushar Khot, Ashish Sabharwal, Carissa Schoenick, and Oyvind Tafjord. 2018 · 2018

Earlier work this paper cites.

Curriculumnet: Weakly supervised learning from large-scale web images

Sheng Guo, Weilin Huang, Haozhi Zhang, Chenfan Zhuang, Dengke Dong, Matthew R Scott, and Dinglong Huang. 2018 · 2018

Earlier work this paper cites.

Winogrande: An adversarial winograd schema challenge at scale

2019 · 2019

Earlier work this paper cites.

Transformer models for text-based emotion detection: a review of bert-based approaches

Francisca Adoma Acheampong, Henry Nunoo-Mensah, and Wenyu Chen. 2021 · 2021

Earlier work this paper cites.

Does the order of training samples matter? improving neural data-to-text generation with curriculum learning

Original

Ernie Chang, Hui-Syuan Yeh, and Vera Demberg. 2021 · 2021

Cited alongside, same era.

Training verifiers to solve math word problems

Original

Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman. 2021 · 2021

Cited alongside, same era.

Measuring massive multitask language understanding

Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. 2021 · 2021

Cited alongside, same era.

Lora: Low-rank adaptation of large language models

Original

Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021 · 2021

Cited alongside, same era.

Truthfulqa: Measuring how models mimic human falsehoods

Orca: Progressive learning from complex explanation traces of gpt-4

Original

Subhabrata Mukherjee, Arindam Mitra, Ganesh Jawahar, Sahaj Agarwal, Hamid Palangi, and Ahmed Awadallah. 2023 · 2023

Later among the works it cites.

Length-based curriculum learning for efficient pre-training of language models

Koichi Nagatsuka, Clifford Broni-Bediako, and Masayasu Atsumi. 2023 · 2023

Later among the works it cites.

Transformers in the real world: A survey on nlp applications

Narendra Patwardhan, Stefano Marrone, and Carlo Sansone. 2023 · 2023

Later among the works it cites.

Stanford alpaca: An instruction-following llama model

Rohan Taori, Ishaan Gulrajani, Tianyi Zhang, Yann Dubois, Xuechen Li, Carlos Guestrin, Percy Liang, and Tatsunori B. Hashimoto. 2023 · 2023

Later among the works it cites.

Analyzing amazon products sentiment: a comparative study of machine and deep learning, and transformer-based techniques

Hashir Ali, Ehtesham Hashmi, Sule Yayilgan Yildirim, and Sarang Shaikh. 2024 · 2024

Closest in time.