Adaptive Dialog Policy Learning with Hindsight and User Modeling

Understand

Reinforcement learning methods have been used to compute dialog policies from language-based interaction experiences.

• Efficiency is of particular importance in dialog policy learning, because of the considerable cost of interacting with people, and the very poor user experience from low-quality conversations.
• Aiming at improving the efficiency of dialog policy learning, we develop algorithm LHUA (Learning with Hindsight, User modeling, and Adaptation) that, for the first time, enables dialog agents to adaptively learn with hindsight from both simulated and real users.
• Simulation and hindsight provide the dialog agent with more experience and more (positive) reinforcements respectively.