Towards Modular Machine Learning Solution Development: Benefits and Trade-offs

Distilling the knowledge in a neural network

Original

Hinton, G. E., Vinyals, O., and Dean, J · 2015

Earlier work this paper cites.

U-net: Convolutional networks for biomedical image segmentation

Ronneberger, O., Fischer, P., and Brox, T · 2015

Earlier work this paper cites.

Learning to compose neural networks for question answering

Original

Andreas, J., Rohrbach, M., Darrell, T., and Klein, D · 2016

Earlier work this paper cites.

Filmy cloud removal on satellite imagery with multispectral conditional generative adversarial nets

Enomoto, K., Sakurada, K., Wang, W., Fukui, H., Matsuoka, M., Nakamura, R., and Kawaguchi, N · 2017

Earlier work this paper cites.

Image-to-image translation with conditional adversarial networks

Isola, P., Zhu, J., Zhou, T., and Efros, A. A · 2017

Earlier work this paper cites.

Ensemble learning: A survey

Sagi, O. and Rokach, L · 2018

Earlier work this paper cites.

Recursive routing networks: Learning to compose modules for language understanding

Cases, I., Rosenbaum, C., Riemer, M., Geiger, A., Klinger, T., Tamkin, A., Li, O., Agarwal, S., Greene, J. D., Jurafsky, D., et al · 2019

Cited alongside, same era.

BERT: pre-training of deep bidirectional transformers for language understanding

Devlin, J., Chang, M., Lee, K., and Toutanova, K · 2019

Cited alongside, same era.

Eurosat: A novel dataset and deep learning benchmark for land use and land cover classification

Helber, P., Bischke, B., Dengel, A., and Borth, D · 2019

Cited alongside, same era.

Efficientnet: Rethinking model scaling for convolutional neural networks

Tan, M. and Le, Q. V · 2019

Cited alongside, same era.

Huggingface’s transformers: State-of-the-art natural language processing

Original

Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., and Brew, J · 2019

Cited alongside, same era.

The multilingual amazon reviews corpus

Keung, P., Lu, Y., Szarvas, G., and Smith, N. A · 2020

Later among the works it cites.

The Tatoeba Translation Challenge – Realistic data sets for low resource and multilingual MT

Tiedemann, J · 2020

Later among the works it cites.

A comprehensive survey on transfer learning

Original

Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., and He, Q · 2020

Later among the works it cites.

Are neural nets modular? inspecting functional modularity through differentiable weight masks

Csordás, R., van Steenkiste, S., and Schmidhuber, J · 2021

Later among the works it cites.

Towards a robust knowledge graph-enabled machine learning service description framework

Menik, S. and Ramaswamy, L · 2021

Later among the works it cites.