2020

Behavior Priors for Efficient Reinforcement Learning

Tirumala, Dhruva, Galashov, Alexandre, Noh, Hyeonwoo et al.

Understand

As we deploy reinforcement learning agents to solve increasingly challenging problems, methods that allow us to inject prior knowledge about the structure of the world and effective solution strategies becomes increasingly important.

  • In this work we consider how information and architectural constraints can be combined with ideas from the probabilistic modeling literature to learn behavior priors that capture the common movement and interaction patterns that are shared across a set of related tasks or contexts.
  • For example the day-to day behavior of humans comprises distinctive locomotion and manipulation patterns that recur across many different situations and goals.
  • We discuss how such behavior patterns can be captured using probabilistic trajectory models and how these can be integrated effectively into reinforcement learning schemes, e.g.\ to facilitate multi-task and transfer learning.

Reading the bibliography…