Fetching the paper…
Reading the bibliography…
Decoding human visual neural representations is a challenging task with great scientific significance in revealing vision-processing mechanisms and developing brain-like intelligent machines.
T. B. Brown, B. Mann et al. , “Language models are few-shot learners,” in Proc. Adv. Neural Inf. Process. Syst. , 2020, pp. 1877–1901
1901
Earlier work this paper cites.
J. V. Haxby, M. I. Gobbini et al. , “Distributed and overlapping representations of faces and objects in ventral temporal cortex,” Science , vol. 293, no. 5539, pp. 2425–2430, 2001
2001
Earlier work this paper cites.
D. B. F. Agakov, “The im algorithm: a variational approach to information maximization,” Proc. Adv. Neural Inf. Process. Syst. , vol. 16, p. 201, 2004
2004
Earlier work this paper cites.
Y. Kamitani and F. Tong, “Decoding the visual and subjective contents of the human brain,” Nat. Neurosci. , vol. 8, no. 5, p. 679, 2005
2005
Earlier work this paper cites.
T. M. Mitchell, S. V. Shinkareva et al. , “Predicting human brain activity associated with the meanings of nouns,” Science , vol. 320, no. 5880, pp. 1191–1195, 2008
2008
Earlier work this paper cites.
K. N. Kay, T. Naselaris et al. , “Identifying natural images from human brain activity,” Nature , vol. 452, no. 7185, p. 352, 2008
2008
Earlier work this paper cites.
L. Van der Maaten and G. Hinton, “Visualizing data using t-SNE.” J. Mach. Learn. Research , vol. 9, no. 11, 2008
2008
Earlier work this paper cites.
M. Palatucci, D. Pomerleau et al. , “Zero-shot learning with semantic output codes,” in Proc. Int. Conf. Neural Inf. Process. Syst. , vol. 22, 2009
2009
Earlier work this paper cites.
M. A. Van Gerven, B. Cseke, F. P. De Lange, and T. Heskes, “Efficient Bayesian multivariate fMRI analysis using a sparsifying spatio-temporal prior,” NeuroImage , vol. 50, no. 1, pp. 150–161, 2010
2010
Earlier work this paper cites.
J. Mitchell and M. Lapata, “Composition in distributional models of semantics,” Cognitive science , vol. 34, no. 8, pp. 1388–1429, 2010
2010
Earlier work this paper cites.
J. J. DiCarlo, D. Zoccolan, and N. C. Rust, “How does the brain solve visual object recognition?” Neuron , vol. 73, no. 3, pp. 415–434, 2012
2012
Earlier work this paper cites.
A. Paivio, Imagery and verbal processes . Psychology Press, 2013
2013
Earlier work this paper cites.
S. R. Damarla and M. A. Just, “Decoding the representation of numerical values from brain activation patterns,” Human Brain Mapping , vol. 34, no. 10, pp. 2624–2634, 2013
2013
Earlier work this paper cites.
A. Frome, G. S. Corrado, J. Shlens, S. Bengio, J. Dean, M. Ranzato, and T. Mikolov, “Devise: A deep visual-semantic embedding model,” in Proc. Adv. Neural Inf. Process. Syst. , 2013, pp. 2121–2129
2013
Earlier work this paper cites.
F. Hill and A. Korhonen, “Learning abstract concept embeddings from multi-modal data: Since you probably can’t see what i mean,” in Proc. Conf. Empirical Methods Natural Lang. Process. , 2014, pp. 255–265
2014
Earlier work this paper cites.
D. P. Kingma and M. Welling, “Auto-encoding variational Bayes,” in Proc. Int. Conf. Learn. Representations , 2014, pp. 1–14
2014
Earlier work this paper cites.
D. J. Rezende, S. Mohamed, and D. Wierstra, “Stochastic backpropagation and approximate inference in deep generative models,” in Proc. Annu. Int. Conf. Mach. Learn. , 2014, pp. 1278–1286
2014
Earlier work this paper cites.
2014
Earlier work this paper cites.
B. Romera-Paredes and P. Torr, “An embarrassingly simple approach to zero-shot learning,” in Proc. Annu. Int. Conf. Mach. Learn. , 2015, pp. 2152–2161
2015
Earlier work this paper cites.
Z. Zhang and V. Saligrama, “Zero-shot learning via semantic similarity embedding,” in Proc. IEEE Int. Conf. Comput. Vis. , 2015, pp. 4166–4174
2015
Earlier work this paper cites.
J. S. Gao, A. G. Huth et al. , “Pycortex: an interactive surface visualizer for fMRI,” Front. Neuroinform. , pp. 23–35, 2015
2015
Earlier work this paper cites.
A. G. Huth, W. A. De Heer et al. , “Natural speech reveals the semantic maps that tile human cerebral cortex,” Nature , vol. 532, no. 7600, pp. 453–458, 2016
2016
Earlier work this paper cites.
Y. Xian, Z. Akata, G. Sharma, Q. Nguyen, M. Hein, and B. Schiele, “Latent embeddings for zero-shot classification,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. , 2016, pp. 69–77
2016
Earlier work this paper cites.
A. A. Alemi, I. Fischer, J. V. Dillon, and K. Murphy, “Deep variational information bottleneck,” in Proc. Int. Conf. Learn. Representations , 2016, pp. 1–19
2016
Earlier work this paper cites.
S. R. Bowman, L. Vilnis et al. , “Generating sentences from a continuous space,” in Proc. Conf. Comput. Natural Language Learn. , 2016, pp. 10–21
2016
Earlier work this paper cites.
X. Chen, Y. Duan et al. , “InfoGan: Interpretable representation learning by information maximizing generative adversarial nets,” in Proc. Adv. Neural Inf. Process. Syst. , 2016, pp. 1–9
2016
Earlier work this paper cites.
T. Horikawa and Y. Kamitani, “Generic decoding of seen and imagined objects using hierarchical visual features,” Nat. Commun. , vol. 8, p. 15037, 2017
2017
Earlier work this paper cites.
C. Spampinato, S. Palazzo et al. , “Deep learning human mind for automated visual classification,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. , 2017
2017
Earlier work this paper cites.
Y.-H. H. Tsai, L.-K. Huang, and R. Salakhutdinov, “Learning robust visual-semantic embeddings,” in Proc. IEEE Int. Conf. Comput. Vis. , 2017, pp. 3591–3600
2017
Cited alongside, same era.
A. J. Anderson, D. Kiela, S. Clark, and M. Poesio, “Visually grounded and textual semantic models differentially decode brain activity associated with concrete and abstract nouns,” Trans. Assoc. Computat. Linguistics , vol. 5, pp. 17–30, 2017
2017
Cited alongside, same era.
L. Bulat, S. Clark, and E. Shutova, “Speaking, seeing, understanding: Correlating semantic models with conceptual representation in the brain,” in Proc. Conf. Empirical Methods Natural Lang. Process. , 2017, pp. 1081–1091
2017
Cited alongside, same era.
A. Vaswani, N. Shazeer et al. , “Attention is all you need,” in Proc. Adv. Neural Inf. Process. Syst. , 2017, pp. 5998–6008
2017
Cited alongside, same era.
M. N. Hebart, A. H. Dickter et al. , “Things: A database of 1,854 object concepts and more than 26,000 naturalistic object images,” PloS one , vol. 14, no. 10, p. e0223792, 2019
2019
Later among the works it cites.
J. Kubilius, M. Schrimpf et al. , “Brain-like object recognition with high-performing shallow recurrent anns,” Proc. Adv. Neural Inf. Process. Syst. , vol. 32, pp. 1–12, 2019
2019
Later among the works it cites.
C. Du, J. Li et al. , “Brain encoding and decoding in fMRI with bidirectional deep generative models,” Engineering , vol. 5, no. 5, pp. 948–953, 2019
2019
Later among the works it cites.
OpenAI, “GPT-4 technical report,” arXiv preprint arXiv:2303.08774v2 , 2023
2019
Later among the works it cites.
S. Palazzo, C. Spampinato et al. , “Decoding brain representations by multimodal learning of neural activity and visual features,” IEEE Trans. Pattern Anal. Mach. Intell. , vol. 43, no. 11, pp. 3833–3849, 2020
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
X. Chen, D. P. Kingma et al. , “Variational lossy autoencoder,” in Proc. Int. Conf. Learn. Representations , 2017, pp. 1–17
2017
Cited alongside, same era.
A. B. Dieng, D. Tran, R. Ranganath, J. W. Paisley, and D. M. Blei, “Variational inference via χ \chi upper bound minimization,” in Proc. Int. Conf. Neural Inf. Process. Syst. , 2017, pp. 2732–2741
2017
Cited alongside, same era.
C. Du, C. Du, L. Huang, and H. He, “Reconstructing perceived images from human brain activities with Bayesian deep multiview learning,” IEEE Trans. Neural Netw. Learn. Syst. , vol. 30, no. 8, pp. 2310–2323, 2018
2018
Cited alongside, same era.
S. Nishida and S. Nishimoto, “Decoding naturalistic experiences from human brain activity via distributed representations of words,” Neuroimage , vol. 180, pp. 232–242, 2018
2018
Cited alongside, same era.
K. Vodrahalli, P.-H. Chen et al. , “Mapping between fMRI responses to movies and their natural language annotations,” NeuroImage , vol. 180, pp. 223–231, 2018
2018
Cited alongside, same era.
F. Pereira, B. Lou et al. , “Toward a universal decoder of linguistic meaning from brain activation,” Nat. Commun. , vol. 9, no. 1, pp. 1–13, 2018
2018
Cited alongside, same era.
Y. Xian, C. H. Lampert, B. Schiele, and Z. Akata, “Zero-shot learning - a comprehensive evaluation of the good, the bad and the ugly,” IEEE Trans. Pattern Anal. Mach. Intell. , vol. 41, no. 9, pp. 2251–2265, 2018
2018
Cited alongside, same era.
V. K. Verma, G. Arora, A. Mishra, and P. Rai, “Generalized zero-shot learning via synthesized examples,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. , 2018, pp. 4281–4289
2018
Cited alongside, same era.
2020
Later among the works it cites.
C. Du, C. Du et al. , “Structured neural decoding with multitask transfer learning of deep neural network representations,” IEEE Trans. Neural Netw. Learn. Syst. , vol. 33, no. 2, pp. 600–614, 2020
2020
Later among the works it cites.
G. Lupyan, R. Abdel Rahman et al. , “Effects of language on visual perception,” Trends Cogn. Sci. , vol. 24, no. 11, pp. 930–944, 2020
2020
Later among the works it cites.
Y. Akamatsu, R. Harakawa et al. , “Brain decoding of viewed image categories via semi-supervised multi-view Bayesian generative model,” IEEE Trans. Signal Process. , vol. 68, pp. 5769–5781, 2020
2020
Later among the works it cites.
K. He, H. Fan, Y. Wu, S. Xie, and R. Girshick, “Momentum contrast for unsupervised visual representation learning,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. , 2020, pp. 9729–9738
2020
Later among the works it cites.
P. Cheng, W. Hao et al. , “Club: A contrastive log-ratio upper bound of mutual information,” in Proc. Annu. Int. Conf. Mach. Learn. , 2020, pp. 1779–1788
2020
Later among the works it cites.
Z. Lan, M. Chen et al. , “ALBERT: A lite BERT for self-supervised learning of language representations,” in Proc. Int. Conf. Learn. Representations , 2020, pp. 1–17
2020
Later among the works it cites.
Y. Bi, “Dual coding of knowledge in the human brain,” Trends Cogn. Sci. , vol. 25, no. 10, pp. 883–895, 2021
2021
Later among the works it cites.
A. Radford, J. W. Kim et al. , “Learning transferable visual models from natural language supervision,” in Proc. Annu. Int. Conf. Mach. Learn. , 2021, pp. 8748–8763
2021
Later among the works it cites.
S. Bujwid and J. Sullivan, “Large-scale zero-shot image classification from rich and diverse textual descriptions,” in Proc. Workshop on Beyond Vision and Lang.: Integrating Real-world Knowledge , 2021, pp. 38–52
2021
Later among the works it cites.
J. Kil and W.-L. Chao, “Revisiting document representations for large-scale zero-shot learning,” in Proc. NAACL-HLT , 2021, pp. 3117–3128
2021
Later among the works it cites.
T. M. Sutter, I. Daunhawer, and J. E. Vogt, “Generalized multimodal ELBO,” in Proc. Int. Conf. Learn. Representations , 2021, pp. 1–23
2021
Later among the works it cites.
H. Ahmed, R. B. Wilbur, H. M. Bharadwaj, and J. M. Siskind, “Object classification from randomized EEG trials,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. , 2021, pp. 3845–3854
2021
Later among the works it cites.
C. Du, C. Du, and H. He, “Multimodal deep generative adversarial models for scalable doubly semi-supervised learning,” Information Fusion , vol. 68, pp. 118–130, 2021
2021
Later among the works it cites.
X. Ding, X. Zhang, N. Ma, J. Han, G. Ding, and J. Sun, “RepVGG: Making vgg-style convnets great again,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. , 2021, pp. 13 733–13 742
2021
Later among the works it cites.
M. Schrimpf, I. A. Blank et al. , “The neural architecture of language: Integrative modeling converges on predictive processing,” Proc. Nat. Acad. Sci. , vol. 118, no. 45, p. e2105646118, 2021
2021
Later among the works it cites.
S. Black, L. Gao, P. Wang, C. Leahy, and S. Biderman, “GPT-Neo: Large scale autoregressive language modeling with mesh-tensorflow,” 2021. [Online]. Available: http://github.com/eleutherai/gpt-neo
2021
Later among the works it cites.
S. F. Popham, A. G. Huth et al. , “Visual and linguistic semantic representations are aligned at the border of human visual cortex,” Nat. Neurosci. , vol. 24, no. 11, pp. 1628–1636, 2021
2021
Later among the works it cites.
S. Nonaka, K. Majima et al. , “Brain hierarchy score: Which deep neural networks are hierarchically brain-like?” IScience , vol. 24, no. 9, p. 103013, 2021
2021
Later among the works it cites.
N. Fei, Z. Lu et al. , “Towards artificial general intelligence via a multimodal foundation model,” Nat. Commun. , vol. 13, no. 1, pp. 1–13, 2022
2022
Closest in time.
A. T. Gifford, K. Dwivedi et al. , “A large and rich EEG dataset for modeling human visual object recognition,” NeuroImage , vol. 264, p. 119754, 2022
2022
Closest in time.
S. R. Oota, J. Arora et al. , “Neural language taskonomy: Which NLP tasks are the most predictive of fMRI brain activity?” in Proc. NAACL-HLT , 2022, pp. 3220–3237
2022
Closest in time.
J. Li, D. Li, C. Xiong, and S. Hoi, “BLIP: Bootstrapping language-image pre-training for unified vision-language understanding and generation,” in Proc. Annu. Int. Conf. Mach. Learn. , 2022, pp. 1–12
2022
Closest in time.