Fetching the paper…
Reading the bibliography…
Attention mechanisms are a central property of cognitive systems allowing them to selectively deploy cognitive resources in a flexible manner.
Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects
Rao, R. P. N. and Ballard, D. H · 1999
Earlier work this paper cites.
A Model of Inductive Bias Learning
Baxter, J · 2000
Earlier work this paper cites.
The Concave-Convex Procedure (CCCP)
Yuille, A. L. and Rangarajan, A · 2001
Earlier work this paper cites.
Object-Centric Learning with Slot Attention, October 2020
Locatello, F., Weissenborn, D., Unterthiner, T., Mahendran, A., Heigold, G., Uszkoreit, J., Dosovitskiy, A., and Kipf, T · 2006
Earlier work this paper cites.
A Collapsed Variational Bayesian Inference Algorithm for Latent Dirichlet Allocation
Teh, Y., Newman, D., and Welling, M · 2006
Earlier work this paper cites.
Predictive coding under the free-energy principle
Friston, K. and Kiebel, S · 2008
Earlier work this paper cites.
Hopfield Networks is All You Need, April 2021
Ramsauer, H., Schäfl, B., Lehner, J., Seidl, P., Widrich, M., Adler, T., Gruber, L., Holzleitner, M., Pavlović, M., Sandve, G. K., Greiff, V., Kreil, D., Kopp, M., Klambauer, G., Brandstetter, J., and Hochreiter, S · 2008
Earlier work this paper cites.
Attention that does not Explain Away, September 2020
Ding, N., Fan, X., Lan, Z., Schuurmans, D., and Soricut, R · 2009
Earlier work this paper cites.
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale, June 2021
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., Uszkoreit, J., and Houlsby, N · 2010
Earlier work this paper cites.
Attention, Uncertainty, and Free-Energy
Feldman, H. and Friston, K · 2010
Cited alongside, same era.
The free energy principle for action and perception: A mathematical review
Buckley, C. L., Kim, C. S., McGregor, S., and Seth, A. K · 2017
Cited alongside, same era.
Structured Attention Networks, February 2017
Kim, Y., Denton, C., Hoang, L., and Rush, A. M · 2017
Cited alongside, same era.
Attention Is All You Need, December 2017
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., and Polosukhin, I · 2017
Cited alongside, same era.
Latent Alignment and Variational Attention
Deng, Y., Kim, Y., Chiu, J., Guo, D., and Rush, A · 2018
Cited alongside, same era.
On Learning Continuous Pairwise Markov Random Fields
Shah, A., Shah, D., and Wornell, G · 2021
Later among the works it cites.
On the Relationship Between Variational Inference and Auto-Associative Memory, October 2022
Annabi, L., Pitti, A., and Quoy, M · 2022
Later among the works it cites.
Bregman Neural Networks
Frecon, J., Gasso, G., Pontil, M., and Salzo, S · 2022
Later among the works it cites.
A Theoretical Framework for Inference and Learning in Predictive Coding Networks, August 2022
Millidge, B., Song, Y., Salvatori, T., Lukasiewicz, T., and Bogacz, R · 2022
Later among the works it cites.
Improving Transformers with Probabilistic Attention Keys
Nguyen, T. M., Nguyen, T. M., Le, D. D. D., Nguyen, D. K., Tran, V.-A., Baraniuk, R., Ho, N., and Osher, S · 2022
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Shankar, S., Garg, S., and Sarawagi, S · 2018
Cited alongside, same era.
Attention in Psychology, Neuroscience, and Machine Learning
Lindsay, G. W · 2020
Cited alongside, same era.
Probabilistic Attention for Interactive Segmentation, July 2021
Gabbur, P., Bilkhu, M., and Movellan, J · 2021
Cited alongside, same era.
Perceiver: General Perception with Iterative Attention
Jaegle, A., Gimeno, F., Brock, A., Vinyals, O., Zisserman, A., and Carreira, J · 2021
Cited alongside, same era.
Singh, G., Kim, Y., and Ahn, S · 2022
Later among the works it cites.
Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks, August 2022
Wang, W., Bao, H., Dong, L., Bjorck, J., Peng, Z., Liu, Q., Aggarwal, K., Mohammed, O. K., Singhal, S., Som, S., and Wei, F · 2022
Later among the works it cites.
Transformers from an Optimization Perspective, May 2022
Yang, Y., Huang, Z., and Wipf, D · 2022
Later among the works it cites.