2018

Adapting Mask-RCNN for Automatic Nucleus Segmentation

Johnson, Jeremiah W.

Understand

Automatic segmentation of microscopy images is an important task in medical image processing and analysis.

Nucleus detection is an important example of this task.
Mask-RCNN is a recently proposed state-of-the-art algorithm for object detection, object localization, and object instance segmentation of natural images.
In this paper we demonstrate that Mask-RCNN can be used to perform highly effective and efficient automatic segmentations of a wide range of microscopy images of cell nuclei, for a variety of cells acquired under a variety of conditions.

Built on

Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion
Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., and Manzagol, P.-A · 2010
Earlier work this paper cites.
Imagenet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., and Hinton, G. E · 2012
Earlier work this paper cites.
Annotated high-throughput microscopy image sets for validation
Ljosa, V., Sokolnicki, K. L., and Carpenter, A. E · 2012
Earlier work this paper cites.
Auto-encoding variational bayes
Original
Kingma, D. P., and Welling, M · 2013
Earlier work this paper cites.
Deep Feature Learning for Knee Cartilage Segmentation Using a Triplanar Convolutional Neural Network
Prasoon, A., Petersen, K., Igel, C., Lauze, F., Dam, E., and Nielsen, M · 2013
Earlier work this paper cites.
Rich feature hierarchies for accurate object detection and semantic segmentation
Girshick, R., Donahue, J., Darrell, T., and Malik, J · 2014
Earlier work this paper cites.
Microsoft COCO: Common objects in context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C. L · 2014
Earlier work this paper cites.
Very deep convolutional networks for large-scale image recognition
Original
Simonyan, K., and Zisserman, A · 2014
Earlier work this paper cites.
TensorFlow: Large-scale machine learning on heterogeneous systems, 2015
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., Ghemawat, S., Goodfellow, I., Harp, A., Irving, G., Isard, M., Jia, Y., Jozefowicz, R., Kaiser, L., Kudlur, M., Levenberg, J., Mané, D., Monga, R., Moore, S., Murray, D., Olah, C., Schuster, M., Shlens, J., Steiner, B., Sutskever, I., Talwar, K., Tucker, P., Vanhoucke, V., Vasudevan, V., Viégas, F., Vinyals, O., Warden, P., Wattenberg, M., Wicke, M., Yu, Y., and Zheng, X · 2015
Earlier work this paper cites.
Fast R-CNN
Original
Girshick, R · 2015
Earlier work this paper cites.
Deep residual learning for image recognition
Original
He, K., Zhang, X., Ren, S., and Sun, J · 2015
Earlier work this paper cites.

Similar

Faster R-CNN: towards real-time object detection with region proposal networks
Original
Ren, S., He, K., Girshick, R. B., and Sun, J · 2015
Cited alongside, same era.
U-net: Convolutional networks for biomedical image segmentation
Original
Ronneberger, O., P.Fischer, and Brox, T · 2015
Cited alongside, same era.
3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., S. Lienkamp, S., Brox, T., and Ronneberger, O · 2016
Cited alongside, same era.
Perceptual losses for real-time style transfer and super-resolution
Johnson, J., Alahi, A., and Fei-Fei, L · 2016
Cited alongside, same era.
Feature pyramid networks for object detection
Original
Lin, T., Dollár, P., Girshick, R. B., He, K., Hariharan, B., and Belongie, S. J · 2016
Cited alongside, same era.
Convolutional neural networks for diabetic retinopathy
Pratt, H., Coenen, F., Broadbent, D. M., Harding, S. P., and Zheng, Y · 2016
Cited alongside, same era.
A fully convolutional neural network for cardiac segmentation in short-axis MRI
Original
Tran, P. V · 2016
Cited alongside, same era.
Multi-scale context aggregation by dilated convolutions
Yu, F., and Koltun, V · 2016
Cited alongside, same era.
A multipath network for object detection
Original
Zagoruyko, S., Lerer, A., Lin, T., Pinheiro, P. H. O., Gross, S., Chintala, S., and Dollár, P · 2016
Cited alongside, same era.
Segnet: A deep convolutional encoder-decoder architecture for image segmentation
Badrinarayanan, V., Kendall, A., and Cipolla, R · 2017
Cited alongside, same era.
Automatic liver and tumor segmentation of CT and MRI volumes using cascaded fully convolutional neural networks
Original
Christ, P. F., Ettlinger, F., Grün, F., Elshaer, M. E. A., Lipková, J., Schlecht, S., Ahmaddy, F., Tatavarty, S., Bickel, M., Bilic, P., Rempfler, M., Hofmann, F., D’Anastasi, M., Ahmadi, S., Kaissis, G., Holch, J., Sommer, W. H., Braren, R., Heinemann, V., and Menze, B. H · 2017
Cited alongside, same era.
Ssd: Single shot multibox detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A. C
Cited in the paper.

Then

Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., and Thrun, S · 2017
Later among the works it cites.
Framing U-Net via deep convolutional framelets: Application to sparse-view CT
Original
Han, Y., and Ye, J. C · 2017
Later among the works it cites.
Mask R-CNN
Original
He, K., Gkioxari, G., Dollár, P., and Girshick, R. B · 2017
Later among the works it cites.
Ejection fraction estimation using a wide convolutional neural network
Kabani, A., and El-Sakka, M. R · 2017
Later among the works it cites.
RefineNet: Multi-path refinement networks for high-resolution semantic segmentation
Lin, G., Milan, A., Shen, C., and Reid, I · 2017
Later among the works it cites.
Focal loss for dense object detection
Original
Lin, T., Goyal, P., Girshick, R. B., He, K., and Dollár, P · 2017
Later among the works it cites.
Fully convolutional networks for semantic segmentation
Shelhamer, E., Long, J., and Darrell, T · 2017
Later among the works it cites.
Adversarial deep structured nets for mass segmentation from mammograms
Original
Zhu, W., Xiang, X., Tran, T. D., Hager, G. D., and Xie, X · 2017
Later among the works it cites.
https://github.com/matterport/Mask_RCNN
Mask-RCNN · 2018
Closest in time.
Yolov3: An incremental improvement
Redmon, J., and Farhadi, A · 2018
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…