Live Score Following on Sheet Music Images

Understand

In this demo we show a novel approach to score following.

• Instead of relying on some symbolic representation, we are using a multi-modal convolutional neural network to match the incoming audio stream directly to sheet music images.
• This approach is in an early stage and should be seen as proof of concept.
• Nonetheless, the audience will have the opportunity to test our implementation themselves via 3 simple piano pieces.