Delays in Reinforcement Learning

Understand

Delays are inherent to most dynamical systems.

• Besides shifting the process in time, they can significantly affect their performance.
• For this reason, it is usually valuable to study the delay and account for it.
• Because they are dynamical systems, it is of no surprise that sequential decision-making problems such as Markov decision processes (MDP) can also be affected by delays.