Parameter Transfer Unit for Deep Neural Networks

Understand

Parameters in deep neural networks which are trained on large-scale databases can generalize across multiple domains, which is referred as "transferability".

• Unfortunately, the transferability is usually defined as discrete states and it differs with domains and network architectures.
• Existing works usually heuristically apply parameter-sharing or fine-tuning, and there is no principled approach to learn a parameter transfer strategy.
• To address the gap, a parameter transfer unit (PTU) is proposed in this paper.