Online Spatio-Temporal Learning with Target Projection

Understand

Recurrent neural networks trained with the backpropagation through time (BPTT) algorithm have led to astounding successes in various temporal tasks.

• However, BPTT introduces severe limitations, such as the requirement to propagate information backwards through time, the weight symmetry requirement, as well as update-locking in space and time.
• These problems become roadblocks for AI systems where online training capabilities are vital.
• Recently, researchers have developed biologically-inspired training algorithms, addressing a subset of those problems.