Scan, Attend and Read: End-to-End Handwritten Paragraph Recognition with MDLSTM Attention

Understand

We present an attention-based model for end-to-end handwriting recognition.

• Our system does not require any segmentation of the input paragraph.
• The model is inspired by the differentiable attention models presented recently for speech recognition, image captioning or translation.
• The main difference is the covert and overt attention, implemented as a multi-dimensional LSTM network.