Musical instrument sound classification with deep convolutional neural network using feature fusion approach

Understand

A new musical instrument classification method using convolutional neural networks (CNNs) is presented in this paper.

• Unlike the traditional methods, we investigated a scheme for classifying musical instruments using the learned features from CNNs.
• To create the learned features from CNNs, we not only used a conventional spectrogram image, but also proposed multiresolution recurrence plots (MRPs) that contain the phase information of a raw input signal.
• Consequently, we fed the characteristic timbre of the particular instrument into a neural network, which cannot be extracted using a phase-blinded representations such as a spectrogram.