Large Language Models are Diverse Role-Players for Summarization Evaluation

Hidi, S., Baird, W.: Interestingness—a neglected variable in discourse processing. Cognitive science 10

1986

Earlier work this paper cites.

Rubner, Y., Tomasi, C., Guibas, L.J.: The earth mover’s distance as a metric for image retrieval. International journal of computer vision 40

2000

Earlier work this paper cites.

Papineni, K., Roukos, S., Ward, T., Zhu, W.J.: Bleu: a method for automatic evaluation of machine translation. In: ACL. pp. 311–318 (2002)

2002

Earlier work this paper cites.

Lin, C.Y.: Rouge: A package for automatic evaluation of summaries. In: Text summarization branches out. pp. 74–81 (2004)

2004

Earlier work this paper cites.

Banerjee, S., Lavie, A.: Meteor: An automatic metric for mt evaluation with improved correlation with human judgments. In: Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and/or summarization. pp. 65–72 (2005)

2005

Earlier work this paper cites.

Gao, J., Pantel, P., Gamon, M., He, X., Deng, L.: Modeling interestingness with deep neural networks. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). pp. 2–13 (2014)

2014

Earlier work this paper cites.

Hermann, K.M., Kocisky, T., Grefenstette, E., Espeholt, L., Kay, W., Suleyman, M., Blunsom, P.: Teaching machines to read and comprehend. NIPS 28

2015

Earlier work this paper cites.

Nallapati, R., Zhou, B., Gulcehre, C., Xiang, B., et al.: Abstractive text summarization using sequence-to-sequence rnns and beyond. arXiv preprint arXiv:1602.06023 (2016)

Original

2016

Earlier work this paper cites.

Ma, Q., Bojar, O., Graham, Y.: Results of the wmt18 metrics shared task: Both characters and embeddings achieve good performance. In: Proceedings of the third conference on machine translation: shared task papers. pp. 671–688 (2018)

2018

Cited alongside, same era.

Narayan, S., Cohen, S.B., Lapata, M.: Don’t give me the details, just the summary! topic-aware convolutional neural networks for extreme summarization. arXiv preprint arXiv:1808.08745 (2018)

Original

2018

Cited alongside, same era.

Reimers, N., Gurevych, I.: Sentence-bert: Sentence embeddings using siamese bert-networks. In: EMNLP. pp. 3982–3992 (2019)

2019

Cited alongside, same era.

Zhang, T., Kishore, V., Wu, F., Weinberger, K.Q., Artzi, Y.: Bertscore: Evaluating text generation with bert. arXiv preprint arXiv:1904.09675 (2019)

Original

2019

Cited alongside, same era.

Sanh, V., Webson, A., Raffel, C., Bach, S.H., Sutawika, L., Alyafeai, Z., Chaffin, A., Stiegler, A., Scao, T.L., Raja, A., et al.: Multitask prompted training enables zero-shot task generalization. arXiv preprint arXiv:2110.08207 (2021)

Original

2021

Later among the works it cites.

Goyal, T., Li, J.J., Durrett, G.: News summarization and evaluation in the era of gpt-3. arXiv preprint arXiv:2209.12356 (2022)

Original

2022

Later among the works it cites.

Kojima, T., Gu, S.S., Reid, M., Matsuo, Y., Iwasawa, Y.: Large language models are zero-shot reasoners. arXiv preprint arXiv:2205.11916 (2022)

Original

2022

Later among the works it cites.

Wang, X., Wei, J., Schuurmans, D., Le, Q., Chi, E., Zhou, D.: Self-consistency improves chain of thought reasoning in language models. arXiv preprint arXiv:2203.11171 (2022)

Original

2022

Later among the works it cites.