Fetching the paper…

Reading the bibliography…

2021

A remark on a paper of Krotov and Hopfield [arXiv:2008.06996]

Tang, Fei, Kopp, Michael

Original
PDF
Post on X

Understand

In their recent paper titled "Large Associative Memory Problem in Neurobiology and Machine Learning" [arXiv:2008.06996] the authors gave a biologically plausible microscopic theory from which one can recover many dense associative memory models discussed in the literature.

We show that the layers of the recent "MLP-mixer" [arXiv:2105.01601] as well as the essentially equivalent model in [arXiv:2105.02723] are amongst them.

A remark on a paper of Krotov and Hopfield [arXiv:2008.06996] · Around

Built on

D. Krotov and J. J. Hopfield, “Dense associative memory for pattern recognition,” 2016
2016
Earlier work this paper cites.
D. Krotov and J. Hopfield, “Large associative memory problem in neurobiology and machine learning,” 2021
2021
Earlier work this paper cites.

Similar

I. Tolstikhin, N. Houlsby, A. Kolesnikov, L. Beyer, X. Zhai, T. Unterthiner, J. Yung, A. Steiner, D. Keysers, J. Uszkoreit, M. Lucic, and A. Dosovitskiy, “Mlp-mixer: An all-mlp architecture for vision,” 2021
2021
Cited alongside, same era.
L. Melas-Kyriazi, “Do you even need attention? a stack of feed-forward layers does surprisingly well on imagenet,” 2021
2021
Cited alongside, same era.

Then

H. Ramsauer, B. Schäfl, J. Lehner, P. Seidl, M. Widrich, T. Adler, L. Gruber, M. Holzleitner, M. Pavlović, G. K. Sandve, V. Greiff, D. Kreil, M. Kopp, G. Klambauer, J. Brandstetter, and S. Hochreiter, “Hopfield networks is all you need,” 2021
Original
2021
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…