Evaluation of Transfer Learning for Polish with a Text-to-Text Model

Understand

We introduce a new benchmark for assessing the quality of text-to-text models for Polish.

• The benchmark consists of diverse tasks and datasets: KLEJ benchmark adapted for text-to-text, en-pl translation, summarization, and question answering.
• In particular, since summarization and question answering lack benchmark datasets for the Polish language, we describe their construction and make them publicly available.
• Additionally, we present plT5 - a general-purpose text-to-text model for Polish that can be fine-tuned on various Natural Language Processing (NLP) tasks with a single training objective.