Sentence Semantic Regression for Text Generation

Understand

Recall the classical text generation works, the generation framework can be briefly divided into two phases: \textbf{idea reasoning} and \textbf{surface realization}.

• The target of idea reasoning is to figure out the main idea which will be presented in the following talking/writing periods.
• Surface realization aims to arrange the most appropriate sentence to depict and convey the information distilled from the main idea.
• However, the current popular token-by-token text generation methods ignore this crucial process and suffer from many serious issues, such as idea/topic drift.