Beyond Stemming and Lemmatization: Ultra-stemming to Improve Automatic Text Summarization

Understand

In Automatic Text Summarization, preprocessing is an important phase to reduce the space of textual representation.

• Classically, stemming and lemmatization have been widely used for normalizing words.
• However, even using normalization on large texts, the curse of dimensionality can disturb the performance of summarizers.
• This paper describes a new method for normalization of words to further reduce the space of representation.