Fetching the paper…
Reading the bibliography…
We present MindEye, a novel fMRI-to-image approach to retrieve and reconstruct viewed images from brain activity.
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks, September 2020
Mingxing Tan and Quoc V. Le · 1905
Earlier work this paper cites.
Vicinal risk minimization
Olivier Chapelle, Jason Weston, Léon Bottou, and Vladimir Naumovich Vapnik · 2000
Earlier work this paper cites.
Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex
James V. Haxby, M. Ida Gobbini, Maura L. Furey, Alumit Ishai, Jennifer L. Schouten, and Pietro Pietrini · 2001
Earlier work this paper cites.
Image quality assessment: from error visibility to structural similarity
Zhou Wang, A.C. Bovik, H.R. Sheikh, and E.P. Simoncelli · 2003
Earlier work this paper cites.
Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex
David D Cox and Robert L Savoy · 2003
Earlier work this paper cites.
Predicting the orientation of invisible stimuli from activity in human primary visual cortex
John-Dylan Haynes and Geraint Rees · 2005
Earlier work this paper cites.
Decoding the visual and subjective contents of the human brain
Yukiyasu Kamitani and Frank Tong · 2005
Earlier work this paper cites.
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments, January 2021a
Mathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal, Piotr Bojanowski, and Armand Joulin · 2006
Earlier work this paper cites.
Inverse retinotopy: Inferring the visual content of images from brain activation patterns
Bertrand Thirion, Edouard Duchesnay, Edward Hubbard, Jessica Dubois, Jean-Baptiste Poline, Denis Lebihan, and Stanislas Dehaene · 2006
Earlier work this paper cites.
Denoising Diffusion Probabilistic Models, December 2020
Jonathan Ho, Ajay Jain, and Pieter Abbeel · 2006
Earlier work this paper cites.
Improved Techniques for Training Score-Based Generative Models, October 2020
Yang Song and Stefano Ermon · 2006
Earlier work this paper cites.
Top-Down Activation of Shape-Specific Population Codes in Visual Cortex during Mental Imagery
Mark Stokes, Russell Thompson, Rhodri Cusack, and John Duncan · 2009
Earlier work this paper cites.
Reading the mind’s eye: Decoding category information during mental imagery
Leila Reddy, Naotsugu Tsuchiya, and Thomas Serre · 2009
Earlier work this paper cites.
Willful Modulation of Brain Activity in Disorders of Consciousness
Martin M. Monti, Audrey Vanhaudenhuyse, Martin R. Coleman, Melanie Boly, John D. Pickard, Luaba Tshibanda, Adrian M. Owen, and Steven Laureys · 2010
Earlier work this paper cites.
Encoding and decoding in fMRI
Thomas Naselaris, Kendrick N. Kay, Shinji Nishimoto, and Jack L. Gallant · 2011
Earlier work this paper cites.
Very Deep VAEs Generalize Autoregressive Models and Can Outperform Them on Images, March 2021
Rewon Child · 2011
Earlier work this paper cites.
A Common, High-Dimensional Model of the Representational Space in Human Ventral Temporal Cortex
James V. Haxby, J. Swaroop Guntupalli, Andrew C. Connolly, Yaroslav O. Halchenko, Bryan R. Conroy, M. Ida Gobbini, Michael Hanke, and Peter J. Ramadge · 2011
Earlier work this paper cites.
ImageNet Classification with Deep Convolutional Neural Networks
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton · 2012
Earlier work this paper cites.
Linear reconstruction of perceived images from human brain activity
Sanne Schoenmakers, Markus Barth, Tom Heskes, and Marcel van Gerven · 2013
Earlier work this paper cites.
Microsoft COCO: Common Objects in Context
Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick · 2014
Earlier work this paper cites.
Generative Adversarial Networks, June 2014
Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio · 2014
Earlier work this paper cites.
A voxel-wise encoding model for early visual areas decodes mental images of remembered scenes
Thomas Naselaris, Cheryl A. Olman, Dustin E. Stansbury, Kamil Ugurbil, and Jack L. Gallant · 2014
Earlier work this paper cites.
Distilling the knowledge in a neural network
Geoffrey E. Hinton, Oriol Vinyals, and Jeffrey Dean · 2015
Earlier work this paper cites.
A Reduced-Dimension fMRI Shared Response Model
Po-Hsuan (Cameron) Chen, Janice Chen, Yaara Yeshurun, Uri Hasson, James Haxby, and Peter J Ramadge · 2015
Earlier work this paper cites.
Rethinking the Inception Architecture for Computer Vision
Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jon Shlens, and Zbigniew Wojna · 2016
Earlier work this paper cites.
mixup: Beyond empirical risk minimization
Hongyi Zhang, Moustapha Cissé, Yann Dauphin, and David Lopez-Paz · 2017
Earlier work this paper cites.
Network Dissection: Quantifying Interpretability of Deep Visual Representations, April 2017
David Bau, Bolei Zhou, Aditya Khosla, Aude Oliva, and Antonio Torralba · 2017
Cited alongside, same era.
Loss functions for image restoration with neural networks
Hang Zhao, Orazio Gallo, Iuri Frosio, and Jan Kautz · 2017
Cited alongside, same era.
Enhanced deep residual networks for single image super-resolution
Bee Lim, Sanghyun Son, Heewon Kim, Seungjun Nah, and Kyoung Mu Lee · 2017
Cited alongside, same era.
Autoaugment: Learning augmentation policies from data
Ekin Dogus Cubuk, Barret Zoph, Dandelion Mané, Vijay Vasudevan, and Quoc V. Le · 2018
Cited alongside, same era.
Generative adversarial networks for reconstructing natural images from brain activity
K. Seeliger, U. Güçlü, L. Ambrogioni, Y. Güçlütürk, and M.A.J. van Gerven · 2018
Cited alongside, same era.
Mind Reader: Reconstructing complex images from brain activities, September 2022
Sikun Lin, Thomas Sprague, and Ambuj K. Singh · 2022
Later among the works it cites.
Decoding speech from non-invasive brain recordings, August 2022
Alexandre Défossez, Charlotte Caucheteux, Jérémy Rapin, Ori Kabeli, and Jean-Rémi King · 2022
Later among the works it cites.
LiT: Zero-Shot Transfer with Locked-image text Tuning, June 2022
Xiaohua Zhai, Xiao Wang, Basil Mustafa, Andreas Steiner, Daniel Keysers, Alexander Kolesnikov, and Lucas Beyer · 2022
Later among the works it cites.
Weixin Liang, Yuhui Zhang, Yongchan Kwon, Serena Yeung, and James Zou · 2022
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cutmix: Regularization strategy to train strong classifiers with localizable features
Sangdoo Yun, Dongyoon Han, Seong Joon Oh, Sanghyuk Chun, Junsuk Choe, and Young Joon Yoo · 2019
Cited alongside, same era.
Augmix: A simple data processing method to improve robustness and uncertainty
Dan Hendrycks, Norman Mu, Ekin Dogus Cubuk, Barret Zoph, Justin Gilmer, and Balaji Lakshminarayanan · 2019
Cited alongside, same era.
Reconstructing faces from fMRI patterns using deep generative neural networks
Rufin VanRullen and Leila Reddy · 2019
Cited alongside, same era.
Deep image reconstruction from human brain activity
Guohua Shen, Tomoyasu Horikawa, Kei Majima, and Yukiyasu Kamitani · 2019
Cited alongside, same era.
Attentional bias in depression: understanding mechanisms to improve training and treatment
Anne C Mennen, Kenneth A Norman, and Nicholas B Turk-Browne · 2019
Cited alongside, same era.
Mixco: Mix-up contrastive learning for visual representation
Sungnyun Kim, Gihun Lee, Sangmin Bae, and Seyoung Yun · 2020
Cited alongside, same era.
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction, September 2020
Leland McInnes, John Healy, and James Melville · 2020
Cited alongside, same era.
A massive 7T fMRI dataset to bridge cognitive neuroscience and artificial intelligence
Emily J. Allen, Ghislain St-Yves, Yihan Wu, Jesse L. Breedlove, Jacob S. Prince, Logan T. Dowdle, Matthias Nau, Brad Caron, Franco Pestilli, Ian Charest, J. Benjamin Hutchinson, Thomas Naselaris, and Kendrick Kay · 2022
Later among the works it cites.
LAION-5B: An open large-scale dataset for training next generation image-text models, October 2022
Christoph Schuhmann, Romain Beaumont, Richard Vencu, Cade Gordon, Ross Wightman, Mehdi Cherti, Theo Coombes, Aarush Katta, Clayton Mullis, Mitchell Wortsman, Patrick Schramowski, Srivatsa Kundurthy, Katherine Crowson, Ludwig Schmidt, Robert Kaczmarczyk, and Jenia Jitsev · 2022
Later among the works it cites.
Clip Retrieval: Easily compute clip embeddings and build a clip retrieval system with them, 2022
Romain Beaumont · 2022
Later among the works it cites.
Lambda Diffusers, 2022
Justin Pinkney · 2022
Later among the works it cites.
LAFITE: Towards Language-Free Training for Text-to-Image Generation, March 2022
Yufan Zhou, Ruiyi Zhang, Changyou Chen, Chunyuan Li, Chris Tensmeyer, Tong Yu, Jiuxiang Gu, Jinhui Xu, and Tong Sun · 2022
Later among the works it cites.
On the duality between contrastive and non-contrastive self-supervised learning
Quentin Garrido, Yubei Chen, Adrien Bardes, Laurent Najman, and Yann LeCun · 2022
Later among the works it cites.
Incorporating natural language into vision models improves prediction and understanding of higher visual cortex, September 2022
Aria Y. Wang, Kendrick Kay, Thomas Naselaris, Michael J. Tarr, and Leila Wehbe · 2022
Later among the works it cites.
Reading Imagined Letter Shapes from the Mind’s Eye Using Real-time 7 Tesla fMRI
Rainer Goebel, Rick van Hoof, Salil Bhat, Michael Lührs, and Mario Senden · 2022
Later among the works it cites.
RT-Cloud: A cloud-based software framework to simplify and standardize real-time fMRI
Grant Wallace, Stephen Polcyn, Paula P. Brooks, Anne C. Mennen, Ke Zhao, Paul S. Scotti, Sebastian Michelmann, Kai Li, Nicholas B. Turk-Browne, Jonathan D. Cohen, and Kenneth A. Norman · 2022
Later among the works it cites.
StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasets, May 2022
Axel Sauer, Katja Schwarz, and Andreas Geiger · 2022
Later among the works it cites.
Vector-quantized Image Modeling with Improved VQGAN, June 2022
Jiahui Yu, Xin Li, Jing Yu Koh, Han Zhang, Ruoming Pang, James Qin, Alexander Ku, Yuanzhong Xu, Jason Baldridge, and Yonghui Wu · 2022
Later among the works it cites.
Vicregl: Self-supervised learning of local visual features
Adrien Bardes, Jean Ponce, and Yann LeCun · 2022
Later among the works it cites.
Furkan Ozcelik and Rufin VanRullen · 2023
Closest in time.
Versatile Diffusion: Text, Images and Variations All in One Diffusion Model, March 2023
Xingqian Xu, Zhangyang Wang, Eric Zhang, Kai Wang, and Humphrey Shi · 2023
Closest in time.
Learnable latent embeddings for joint behavioural and neural analysis
Steffen Schneider, Jin Hwa Lee, and Mackenzie Weygandt Mathis · 2023
Closest in time.
Over-training with mixup may hurt generalization
Zixuan Liu and Ziqiao Wang · 2023
Closest in time.
Decoding natural image stimuli from fMRI data with a surface-based convolutional network, March 2023
Zijin Gu, Keith Jamison, Amy Kuceyeski, and Mert Sabuncu · 2023
Closest in time.
UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Models, February 2023
Wenliang Zhao, Lujia Bai, Yongming Rao, Jie Zhou, and Jiwen Lu · 2023
Closest in time.
Semantic reconstruction of continuous language from non-invasive brain recordings
Jerry Tang, Amanda LeBel, Shailee Jain, and Alexander G. Huth · 2023
Closest in time.
Decoding latents to rgb without upscaling
Kevin Turner · 2023
Closest in time.
Hyperrealistic neural decoding for reconstructing faces from fMRI activations via the GAN latent space
Thirza Dado, Yağmur Güçlütürk, Luca Ambrogioni, Gabriëlle Ras, Sander Bosch, Marcel van Gerven, and Umut Güçlü · 2045
Closest in time.
Improving the accuracy of single-trial fMRI response estimates using GLMsingle
Jacob S Prince, Ian Charest, Jan W Kurzawski, John A Pyles, Michael J Tarr, and Kendrick N Kay · 2050
Closest in time.