On Compressing U-net Using Knowledge Distillation

LeCun, Y., Denker, J.S. and Solla, S.A., 1990. Optimal brain damage. In Advances in neural information processing systems

1990

Earlier work this paper cites.

Buciluǎ, C., Caruana, R. and Niculescu-Mizil, A., 2006, August. Model compression. In Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining

2006

Earlier work this paper cites.

Lucchi, A., Smith, K., Achanta, R., Knott, G. and Fua, P., 2012. Supervoxel-based segmentation of mitochondria in em image stacks with learned shape features. IEEE transactions on medical imaging

2012

Earlier work this paper cites.

Simonyan, K. and Zisserman, A., 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv

2014

Earlier work this paper cites.

Han, S., Pool, J., Tran, J. and Dally, W., 2015. Learning both weights and connections for efficient neural network. In Advances in neural information processing systems

2015

Earlier work this paper cites.

Hinton, G., Vinyals, O. and Dean, J., 2015. Distilling the knowledge in a neural network. arXiv preprint arXiv

2015

Earlier work this paper cites.

Ioffe, S. and Szegedy, C., 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv

2015

Cited alongside, same era.

Ronneberger, O., Fischer, P. and Brox, T., 2015, October. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention

2015

Cited alongside, same era.

Song Han, Jeff Pool, John Tran, and William Dally. Learning both weights and connections for efficient neural network. In Advances in neural information processing systems

2015

Cited alongside, same era.

Luo, P., Zhu, Z., Liu, Z., Wang, X. and Tang, X., 2016, February. Face Model Compression by Distilling Knowledge from Neurons. In proceedings of Association for the Advancement of Artificial Intelligence

2016

Cited alongside, same era.

Rastegari, M., Ordonez, V., Redmon, J. and Farhadi, A., 2016, October. Xnor-net: Imagenet classification using binary convolutional neural networks. In European Conference on Computer Vision

2016

Later among the works it cites.

Zhu, C., Han, S., Mao, H. and Dally, W.J., 2016. Trained ternary quantization. arXiv preprint arXiv

Original

2016

Later among the works it cites.

Alvarez, J.M. and Salzmann, M., 2017. Compression-aware training of deep networks. In Advances in Neural Information Processing Systems

2017

Later among the works it cites.

Chen, G., Choi, W., Yu, X., Han, T. and Chandraker, M., 2017. Learning efficient object detection models with knowledge distillation. In Advances in Neural Information Processing Systems

2017

Later among the works it cites.

Wang, C., Lan, X. and Zhang, Y., 2017. Model Distillation with Knowledge Transfer from Face Classification to Alignment and Verification. arXiv preprint arXiv