EmpTransfo: A Multi-head Transformer Architecture for Creating Empathetic Dialog Systems

Understand

Understanding emotions and responding accordingly is one of the biggest challenges of dialog systems.

• This paper presents EmpTransfo, a multi-head Transformer architecture for creating an empathetic dialog system.
• EmpTransfo utilizes state-of-the-art pre-trained models (e.g., OpenAI-GPT) for language generation, though models with different sizes can be used.
• We show that utilizing the history of emotions and other metadata can improve the quality of generated conversations by the dialog system.