KPT: Keyword-guided Pre-training for Grounded Dialog Generation

Understand

Incorporating external knowledge into the response generation process is essential to building more helpful and reliable dialog agents.

• However, collecting knowledge-grounded conversations is often costly, calling for a better pre-trained model for grounded dialog generation that generalizes well w.r.t.
• different types of knowledge.
• In this work, we propose KPT (Keyword-guided Pre-Training), a novel self-supervised pre-training method for grounded dialog generation without relying on extra knowledge annotation.