Scalable Topical Phrase Mining from Text Corpora

Understand

While most topic modeling algorithms model text corpora with unigrams, human interpretation often relies on inherent grouping of terms into phrases.

• As such, we consider the problem of discovering topical phrases of mixed lengths.
• Existing work either performs post processing to the inference results of unigram-based topic models, or utilizes complex n-gram-discovery topic models.
• These methods generally produce low-quality topical phrases or suffer from poor scalability on even moderately-sized datasets.