USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generation

Understand

The lack of meaningful automatic evaluation metrics for dialog has impeded open-domain dialog research.

• Standard language generation metrics have been shown to be ineffective for evaluating dialog models.
• To this end, this paper presents USR, an UnSupervised and Reference-free evaluation metric for dialog.
• USR is a reference-free metric that trains unsupervised models to measure several desirable qualities of dialog.