Hrinchuk, O., Khrulkov, V., Mirvakhabova, L., Orlova, E., & Oseledets, I. (2019). Tensorized embedding layers for efficient model compression. arXiv preprint arXiv:1901.10787

Original

1901

Earlier work this paper cites.

Thakker, U., Beu, J., Gope, D., Zhou, C., Fedorov, I., Dasika, G., & Mattina, M. (2019). Compressing RNNs for IOT devices by 15-38x using Kronecker products. arXiv preprint arXiv:1906.02876

Original

1906

Earlier work this paper cites.

Sanh, V., Debut, L., Chaumond, J., & Wolf, T. (2019). DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. arXiv preprint arXiv:1910.01108

Original

1910

Earlier work this paper cites.

Kuhn, H. W. (1955). The Hungarian method for the assignment problem. Naval research logistics quarterly, 2(1-2), 83-97

1955

Earlier work this paper cites.

Golub, G. H., & Reinsch, C. (1971). Singular value decomposition and least squares solutions. In Handbook for Automatic Computation: Volume II: Linear Algebra (pp. 134-151). Berlin, Heidelberg: Springer Berlin Heidelberg

1971

Earlier work this paper cites.

Bacciu, D., & Mandic, D. P. (2020). Tensor decompositions in deep learning. arXiv preprint arXiv:2002.11835

Original

2002

Earlier work this paper cites.

Oseledets, I. V. (2011). Tensor-Train decomposition. SIAM Journal on Scientific Computing, 33(5), 2295-2317

2011

Earlier work this paper cites.

Hinton, G., Vinyals, O., & Dean, J. (2015). Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531

Original

2015

Earlier work this paper cites.

Novikov, A., Podoprikhin, D., Osokin, A., & Vetrov, D. P. (2015). Tensorizing neural networks. Advances in neural information processing systems, 28

2015

Earlier work this paper cites.

Wu, J. N. (2016, February). Compression of fully-connected layer in neural network by Kronecker product. In 2016 Eighth International Conference on Advanced Computational Intelligence (ICACI) (pp. 173-179). IEEE

2016

Cited alongside, same era.

Atteya, M. J. (2016). Kronecker product with applications. MJ J. Algebra Appl., 1, 1-4

2016

Cited alongside, same era.

Zhao, Q., Zhou, G., Xie, S., Zhang, L., & Cichocki, A. (2016). Tensor Ring decomposition. arXiv preprint arXiv:1606.05535

Original

2016

Cited alongside, same era.

Paperno, D., Kruszewski, G., Lazaridou, A., Pham, Q. N., Bernardi, R., Pezzelle, S., Baroni, M., Boleda, G. & Fernández, R. (2016). The LAMBADA dataset: Word prediction requiring a broad discourse context. arXiv preprint arXiv:1606.06031

Original

2016

Cited alongside, same era.

Merity, S., Xiong, C., Bradbury, J., & Socher, R. (2016). Pointer sentinel mixture models. arXiv preprint arXiv:1609.07843

Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I. (2019). Language models are unsupervised multitask learners. OpenAI blog, 1(8), 9

2019

Later among the works it cites.

Edalati, A., Tahaei, M., Rashid, A., Nia, V. P., Clark, J. J., & Rezagholizadeh, M. (2021). Kronecker decomposition for gpt compression. arXiv preprint arXiv:2110.08152

Original

2021

Later among the works it cites.

Tahaei, M. S., Charlaix, E., Nia, V. P., Ghodsi, A., & Rezagholizadeh, M. (2021). Kroneckerbert: Learning Kronecker decomposition for pre-trained language models via Knowledge Distillation. arXiv preprint arXiv:2109.06243

Original

2021

Later among the works it cites.

Qu, Z., Deng, L., Wang, B., Chen, H., Lin, J., Liang, L., Li, G., Zhang, Z. & Xie, Y. (2021). Hardware-enabled efficient data processing with Tensor-Train decomposition. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 41(2), 372-385

2021

Later among the works it cites.