Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approach

Understand

Zero-shot text classification (0Shot-TC) is a challenging NLU problem to which little attention has been paid by the research community.

• 0Shot-TC aims to associate an appropriate label with a piece of text, irrespective of the text domain and the aspect (e.g., topic, emotion, event, etc.) described by the label.
• And there are only a few articles studying 0Shot-TC, all focusing only on topical categorization which, we argue, is just the tip of the iceberg in 0Shot-TC.
• In addition, the chaotic experiments in literature make no uniform comparison, which blurs the progress.