Dialect Diversity in Text Summarization on Twitter

Understand

Discussions on Twitter involve participation from different communities with different dialects and it is often necessary to summarize a large number of posts into a representative sample to provide a synopsis.

• Yet, any such representative sample should sufficiently portray the underlying dialect diversity to present the voices of different participating communities representing the dialects.
• Extractive summarization algorithms perform the task of constructing subsets that succinctly capture the topic of any given set of posts.
• However, we observe that there is dialect bias in the summaries generated by common summarization approaches, i.e., they often return summaries that under-represent certain dialects.