RoBLEURT Submission for the WMT2021 Metrics Task

RoBERTa: A Robustly Optimized BERT Pretraining Approach

Original

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907

Earlier work this paper cites.

Bleu: a Method for Automatic Evaluation of Machine Translation

Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002 · 2002

Earlier work this paper cites.

A Study of Translation Edit Rate with Targeted Human Annotation

Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, and John Makhoul. 2006 · 2006

Earlier work this paper cites.

chrF: character n-gram F-score for automatic MT evaluation

Maja Popovic. 2015 · 2015

Earlier work this paper cites.

Climbing Mont BLEU: The Strange World of Reachable High-BLEU Translations

Aaron Smith, Christian Hardmeier, and Joerg Tiedemann. 2016 · 2016

Earlier work this paper cites.

chrF++: words helping character n-grams

Maja Popovic. 2017 · 2017

Cited alongside, same era.

Attention Is All You Need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Cited alongside, same era.

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019

Cited alongside, same era.

Results of the WMT19 Metrics Shared Task: Segment-Level and Strong MT Systems Pose Big Challenges

Qingsong Ma, Johnny Wei, Ondřej Bojar, and Yvette Graham. 2019 · 2019

Cited alongside, same era.

Findings of the 2020 Conference on Machine Translation WMT20

Loïc Barrault, Magdalena Biesialska, Ondřej Bojar, Marta R. Costa-jussà, Christian Federmann, Yvette Graham, Roman Grundkiewicz, Barry Haddow, Matthias Huck, Eric Joanis, Tom Kocmi, Philipp Koehn, Chi-kiu Lo, Nikola Ljubešić, Christof Monz, Makoto Morishita, Masaaki Nagata, Toshiaki Nakazawa, Santanu Pal, Matt Post, and Marcos Zampieri. 2020 · 2020

Cited alongside, same era.

Unsupervised Cross-lingual Representation Learning at Scale

Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, and Veselin Stoyanov. 2020 · 2020

Later among the works it cites.

COMET: A neural framework for MT evaluation

Ricardo Rei, Craig Stewart, Ana C. Farinha, and Alon Lavie. 2020 · 2020

Later among the works it cites.

BLEURT: learning robust metrics for text generation

Thibault Sellam, Dipanjan Das, and Ankur P. Parikh. 2020 · 2020

Later among the works it cites.

Automatic Machine Translation Evaluation using Source Language Inputs and Cross-lingual Language Model

Kosuke Takahashi, Katsuhito Sudoh, and Satoshi Nakamura. 2020 · 2020

Later among the works it cites.

BERTScore: Evaluating Text Generation with BERT

Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger, and Yoav Artzi. 2020 · 2020

Later among the works it cites.