Few-Shot Bot: Prompt-Based Learning for Dialogue Systems

Understand

Learning to converse using only a few examples is a great challenge in conversational AI.

• The current best conversational models, which are either good chit-chatters (e.g., BlenderBot) or goal-oriented systems (e.g., MinTL), are language models (LMs) fine-tuned on large conversational datasets.
• Training these models is expensive, both in terms of computational resources and time, and it is hard to keep them up to date with new conversational skills.
• A simple yet unexplored solution is prompt-based few-shot learning (Brown et al.