Sub-network Discovery and Soft-masking for Continual Learning of Mixed Tasks

Understand

Continual learning (CL) has two main objectives: preventing catastrophic forgetting (CF) and encouraging knowledge transfer (KT).

• The existing literature mainly focused on overcoming CF.
• Some work has also been done on KT when the tasks are similar.
• To our knowledge, only one method has been proposed to learn a sequence of mixed tasks.