SepTr: Separable Transformer for Audio Spectrogram Processing

Understand

Following the successful application of vision transformers in multiple computer vision tasks, these models have drawn the attention of the signal processing community.

• This is because signals are often represented as spectrograms (e.g.
• through Discrete Fourier Transform) which can be directly provided as input to vision transformers.
• However, naively applying transformers to spectrograms is suboptimal.