Efficient End-to-End Speech Recognition Using Performers in Conformers

Understand

On-device end-to-end speech recognition poses a high requirement on model efficiency.

• Most prior works improve the efficiency by reducing model sizes.
• We propose to reduce the complexity of model architectures in addition to model sizes.
• More specifically, we reduce the floating-point operations in conformer by replacing the transformer module with a performer.