2017

A Deep Cascade of Convolutional Neural Networks for MR Image Reconstruction

Schlemper, Jo, Caballero, Jose, Hajnal, Joseph V. et al.

Understand

The acquisition of Magnetic Resonance Imaging (MRI) is inherently slow.

Inspired by recent advances in deep learning, we propose a framework for reconstructing MR images from undersampled data using a deep cascade of convolutional neural networks to accelerate the data acquisition process.
We show that for Cartesian undersampling of 2D cardiac MR images, the proposed method outperforms the state-of-the-art compressed sensing approaches, such as dictionary learning-based MRI (DLMRI) reconstruction, in terms of reconstruction error, perceptual quality and reconstruction speed for both 3-fold and 6-fold undersampling.
Compared to DLMRI, the error produced by the method proposed is approximately twice as small, allowing to preserve anatomical structures more faithfully.

Built on

Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back-propagating errors. Cognitive Modeling 5(3), 1 (1988)
1988
Earlier work this paper cites.
Pruessmann, K.P., Weiger, M., Scheidegger, M.B., Boesiger, P., et al.: SENSE: sensitivity encoding for fast MRI. Magnetic Resonance in Medicine 42(5), 952–962 (1999)
1999
Earlier work this paper cites.
Jung, H., Ye, J.C., Kim, E.Y.: Improved k-t BLAST and k-t SENSE using FOCUSS. Magnetic Resonance in Medicine 52, 3201–3226 (2007)
2007
Earlier work this paper cites.
Lustig, M., Donoho, D.L., Santos, J.M., Pauly, J.M.: Compressed sensing MRI. IEEE Signal Processing Magazine 25(2), 72–82 (2008)
2008
Earlier work this paper cites.
Liang, D., Liu, B., Wang, J., Ying, L.: Accelerating SENSE using compressed sensing. Magnetic Resonance in Medicine 62(6), 1574–1584 (2009)
2009
Earlier work this paper cites.
Ravishankar, S., Bresler, Y.: MR image reconstruction from highly undersampled k-space data by dictionary learning. IEEE Transactions on Medical Imaging 30(5), 1028–1041 (2011)
2011
Earlier work this paper cites.
Amin, M., Murase, K.: Learning algorithms in complex-valued neural networks using Wirtinger calculus. Wiley Online Library (2013)
2013
Earlier work this paper cites.
Caballero, J., Price, A.N., Rueckert, D., Hajnal, J.V.: Dictionary learning and time sparsity for dynamic MR data reconstruction. IEEE Transactions on Medical Imaging 33(4), 979–994 (2014)
2014
Earlier work this paper cites.
Huang, J., Chen, C., Axel, L.: Fast multi-contrast MRI reconstruction. Magnetic Resonance Imaging 32(10), 1344–1352 (2014)
2014
Earlier work this paper cites.

Similar

Kingma, D., Ba, J.: Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
Original
2014
Cited alongside, same era.
Uecker, M., Lai, P., Murphy, M.J., Virtue, P., Elad, M., Pauly, J.M., Vasanawala, S.S., Lustig, M.: ESPIRiT - an eigenvalue approach to autocalibrating parallel MRI: where SENSE meets GRAPPA. Magnetic Resonance in Medicine 71(3), 990–1001 (2014)
2014
Cited alongside, same era.
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. arXiv preprint arXiv:1512.03385 (2015)
Original
2015
Cited alongside, same era.
He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In: Proceedings of the IEEE International Conference on Computer Vision. pp. 1026–1034 (2015)
2015
Cited alongside, same era.
Hirabayashi, A., Inamuro, N., Mimura, K., Kurihara, T., Homma, T.: Compressed sensing MRI using sparsity induced from adjacent slice similarity. In: Sampling Theory and Applications (SampTA), 2015 International Conference on. pp. 287–291. IEEE (2015)
2015
Cited alongside, same era.
Jin, K.H., Lee, D., Ye, J.C.: A novel k-space annihilating filter method for unification between compressed sensing and parallel MRI pp. 327–330 (2015)
2015
Cited alongside, same era.
Peng, X., Liang, D.: MR image reconstruction with convolutional characteristic constraint (CoCCo). IEEE Signal Processing Letters 22(8), 1184–1188 (2015)
2015
Cited alongside, same era.
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: Towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems. pp. 91–99 (2015)
2015
Cited alongside, same era.
Ronneberger, O., Fischer, P., Brox, T.: U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. pp. 234–241. Springer (2015)
2015
Cited alongside, same era.

Then

Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 1–9 (2015)
2015
Later among the works it cites.
Yu, F., Koltun, V.: Multi-scale context aggregation by dilated convolutions. arXiv preprint arXiv:1511.07122 (2015)
Original
2015
Later among the works it cites.
Dong, C., Loy, C.C., He, K., Tang, X.: Image super-resolution using deep convolutional networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 38(2), 295–307 (2016)
2016
Later among the works it cites.
Kulkarni, K., Lohit, S., Turaga, P., Kerviche, R., Ashok, A.: ReconNet: Non-iterative reconstruction of images from compressively sensed measurements. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 449–458 (2016)
2016
Later among the works it cites.
Quan, T.M., Jeong, W.K.: Compressed sensing reconstruction of dynamic contrast enhanced MRI using GPU-accelerated convolutional sparse coding. In: Biomedical Imaging (ISBI), 2016 IEEE 13th International Symposium on. pp. 518–521. IEEE (2016)
2016
Later among the works it cites.
Shi, W., Caballero, J., Huszár, F., Totz, J., Aitken, A.P., Bishop, R., Rueckert, D., Wang, Z.: Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 1874–1883 (2016)
2016
Later among the works it cites.
Sun, J., Li, H., Xu, Z., et al.: Deep ADMM-net for compressive sensing MRI. In: Advances In Neural Information Processing Systems. pp. 10–18 (2016)
2016
Later among the works it cites.
Wang, S., Su, Z., Ying, L., Peng, X., Zhu, S., Liang, F., Feng, D., Liang, D.: Accelerating magnetic resonance imaging via deep learning. In: Biomedical Imaging (ISBI), 2016 IEEE 13th International Symposium on. pp. 514–517. IEEE (2016)
2016
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…