Short-answer scoring with ensembles of pretrained language models

Foltz, Peter W., Darrell Laham, and Thomas K. Landauer. “The intelligent essay assessor: Applications to educational technology.” Interactive Multimedia Electronic Journal of Computer-Enhanced Learning 1, no. 2 (1999): 939-944

1999

Earlier work this paper cites.

Burstein, Jill, Claudia Leacock, and Richard Swartz. ”Automated evaluation of essays and short answers.” (2001)

2001

Earlier work this paper cites.

Page, Ellis Batten. “Project Essay Grade: PEG.” (2003)

2003

Earlier work this paper cites.

Attali, Yigal, and Jill Burstein. “Automated essay scoring with e-rater® V. 2.” The Journal of Technology, Learning and Assessment 4, no. 3 (2006)

2006

Earlier work this paper cites.

Williamson, David M., Xiaoming Xi, and F. Jay Breyer. ”A framework for evaluation and use of automated scoring.” Educational measurement: issues and practice 31, no. 1 (2012): 2-13

2012

Earlier work this paper cites.

Basu, Sumit, Chuck Jacobs, and Lucy Vanderwende. ”Powergrading: a clustering approach to amplify human effort for short answer grading.” Transactions of the Association for Computational Linguistics 1 (2013): 391-402

2013

Earlier work this paper cites.

Shermis, Mark D. “State-of-the-art automated essay scoring: Competition, results, and future directions from a United States demonstration.” Assessing Writing 20 (2014): 53-76

2014

Earlier work this paper cites.

Ramachandran, L., Cheng, J., and Foltz, P. 2015. Identifying patterns for short answer scoring using graph-based lexico-semantic text matching. In Proceedings of the Tenth Workshop on Innovative Use of NLP for Building Educational Applications, 97–106

2015

Earlier work this paper cites.

Shermis, Mark D. ”Contrasting state-of-the-art in the machine scoring of short-form constructed responses.” Educational Assessment 20, no. 1 (2015): 46-65

2015

Earlier work this paper cites.

Alikaniotis, Dimitrios, Helen Yannakoudakis, and Marek Rei. “Automatic text scoring using neural networks.” arXiv preprint arXiv:1606.04289 (2016)

Original

2016

Earlier work this paper cites.

Taghipour, Kaveh, and Hwee Tou Ng. “A neural approach to automated essay scoring.” In Proceedings of the 2016 conference on empirical methods in natural language processing, pp. 1882-1891. 2016

2016

Earlier work this paper cites.

Dong, Fei, Yue Zhang, and Jie Yang. “Attention-based recurrent convolutional neural network for automatic essay scoring.” In Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017), pp. 153-162. 2017

2017

Earlier work this paper cites.

Franceschi, Luca, Michele Donini, Paolo Frasconi, and Massimiliano Pontil. ”Forward and reverse gradient-based hyperparameter optimization.” In International Conference on Machine Learning, pp. 1165-1173. PMLR, 2017

2017

Cited alongside, same era.

Loshchilov, Ilya, and Frank Hutter. ”Decoupled weight decay regularization.” arXiv preprint arXiv:1711.05101 (2017)

Original

2017

Cited alongside, same era.

Riordan, B.; Horbach, A.; Cahill, A.; Zesch, T.; and Lee, C. M. 2017. Investigating neural architectures for short answer scoring. In Proceedings of the 12th Workshop on Innovative Use of NLP for Building Educational Applications, 159–168

2017

Cited alongside, same era.

Devlin, Jacob, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. ”Bert: Pre-training of deep bidirectional transformers for language understanding.” arXiv preprint arXiv:1810.04805 (2018)

Original

2018

Cited alongside, same era.

Sung, Chul, Tejas Indulal Dhamecha, and Nirmal Mukhi. ”Improving short answer grading using transformer-based pre-training.” In International Conference on Artificial Intelligence in Education, pp. 469-481. Springer, Cham, 2019

2019

Later among the works it cites.

Takuya Akiba, Shotaro Sano, Toshihiko Yanase, Takeru Ohta,and Masanori Koyama. 2019. Optuna: A Next-generation Hyperparameter Optimization Framework. In KDD

2019

Later among the works it cites.

Wolf, Thomas, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac et al. ”Huggingface’s transformers: State-of-the-art natural language processing.” arXiv preprint arXiv:1910.03771 (2019)

Original

2019

Later among the works it cites.

Yang, Zhilin, Zihang Dai, Yiming Yang, Jaime Carbonell, Russ R. Salakhutdinov, and Quoc V. Le. ”Xlnet: Generalized autoregressive pretraining for language understanding.” Advances in neural information processing systems 32 (2019)

2019

Later among the works it cites.