Speaker conditioning of acoustic models using affine transformation for multi-speaker speech recognition

Understand

This study addresses the problem of single-channel Automatic Speech Recognition of a target speaker within an overlap speech scenario.

• In the proposed method, the hidden representations in the acoustic model are modulated by speaker auxiliary information to recognize only the desired speaker.
• Affine transformation layers are inserted into the acoustic model network to integrate speaker information with the acoustic features.
• The speaker conditioning process allows the acoustic model to perform computation in the context of target-speaker auxiliary information.