Fetching the paper…
Reading the bibliography…
Reconstructions of visual perception from brain activity have improved tremendously, but the practical utility of such methods has been limited.
DCNN-GAN: Reconstructing Realistic Image from fMRI, January 2019
Yunfeng Lin, Jiangbei Li, and Hanjing Wang · 1901
Earlier work this paper cites.
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks, September 2020
Mingxing Tan and Quoc V. Le · 1905
Earlier work this paper cites.
Roman Beliy, Guy Gaziv, Assaf Hoogi, Francesca Strappini, Tal Golan, and Michal Irani · 1907
Earlier work this paper cites.
ZeRO: Memory Optimizations Toward Training Trillion Parameter Models, May 2020
Samyam Rajbhandari, Jeff Rasley, Olatunji Ruwase, and Yuxiong He · 1910
Earlier work this paper cites.
Co-planar stereotaxic atlas of the human brain. 3-Dimensional proportional system: an approach to cerebral imaging
J. Talairach and P. Tournoux · 1990
Earlier work this paper cites.
High-resolution intersubject averaging and a coordinate system for the cortical surface
B. Fischl, M. I. Sereno, R. B. Tootell, and A. M. Dale · 1999
Earlier work this paper cites.
A probabilistic atlas and reference system for the human brain: International Consortium for Brain Mapping (ICBM)
J Mazziotta, A Toga, A Evans, P Fox, J Lancaster, K Zilles, R Woods, T Paus, G Simpson, B Pike, C Holmes, L Collins, P Thompson, D MacDonald, M Iacoboni, T Schormann, K Amunts, N Palomero-Gallagher, S Geyer, L Parsons, K Narr, N Kabani, G Le Goualher, D Boomsma, T Cannon, R Kawashima, and B Mazoyer · 2001
Earlier work this paper cites.
Image quality assessment: from error visibility to structural similarity
Zhou Wang, A.C. Bovik, H.R. Sheikh, and E.P. Simoncelli · 2003
Earlier work this paper cites.
ROUGE: A Package for Automatic Evaluation of Summaries
Chin-Yew Lin · 2004
Earlier work this paper cites.
Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation, October 2020
Nils Reimers and Iryna Gurevych · 2004
Earlier work this paper cites.
METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments
Satanjeev Banerjee and Alon Lavie · 2005
Earlier work this paper cites.
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments, January 2021
Mathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal, Piotr Bojanowski, and Armand Joulin · 2006
Earlier work this paper cites.
A Theory of Object Recognition: Computations and Circuits in the Feedforward Path of the Ventral Stream in Primate Visual Cortex
T. Serre, M. Kouh, C. Cadieu, U. Knoblich, G. Kreiman, and T. Poggio · 2007
Earlier work this paper cites.
fMRI-Based Inter-Subject Cortical Alignment Using Functional Connectivity
Bryan R. Conroy, Benjamin D. Singer, James V. Haxby, and Peter J. Ramadge · 2009
Earlier work this paper cites.
Top-Down Activation of Shape-Specific Population Codes in Visual Cortex during Mental Imagery
Mark Stokes, Russell Thompson, Rhodri Cusack, and John Duncan · 2009
Earlier work this paper cites.
Reading the mind’s eye: Decoding category information during mental imagery
Leila Reddy, Naotsugu Tsuchiya, and Thomas Serre · 2009
Earlier work this paper cites.
Encoding and decoding in fMRI
Thomas Naselaris, Kendrick N. Kay, Shinji Nishimoto, and Jack L. Gallant · 2010
Earlier work this paper cites.
Function-based intersubject alignment of human cortical anatomy
Mert R. Sabuncu, Benjamin D. Singer, Bryan Conroy, Ronald E. Bryan, Peter Jeffrey Ramadge, and James V. Haxby · 2010
Earlier work this paper cites.
Willful Modulation of Brain Activity in Disorders of Consciousness
Martin M. Monti, Audrey Vanhaudenhuyse, Martin R. Coleman, Melanie Boly, John D. Pickard, Luaba Tshibanda, Adrian M. Owen, and Steven Laureys · 2010
Earlier work this paper cites.
A Common, High-Dimensional Model of the Representational Space in Human Ventral Temporal Cortex
James V. Haxby, J. Swaroop Guntupalli, Andrew C. Connolly, Yaroslav O. Halchenko, Bryan R. Conroy, M. Ida Gobbini, Michael Hanke, and Peter J. Ramadge · 2011
Earlier work this paper cites.
ImageNet Classification with Deep Convolutional Neural Networks
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton · 2012
Earlier work this paper cites.
Microsoft COCO: Common Objects in Context
Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick · 2014
Earlier work this paper cites.
A voxel-wise encoding model for early visual areas decodes mental images of remembered scenes
Thomas Naselaris, Cheryl A. Olman, Dustin E. Stansbury, Kamil Ugurbil, and Jack L. Gallant · 2014
Earlier work this paper cites.
A Reduced-Dimension fMRI Shared Response Model
Po-Hsuan (Cameron) Chen, Janice Chen, Yaara Yeshurun, Uri Hasson, James Haxby, and Peter J Ramadge · 2015
Earlier work this paper cites.
Rethinking the Inception Architecture for Computer Vision
Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jon Shlens, and Zbigniew Wojna · 2016
Earlier work this paper cites.
Natural speech reveals the semantic maps that tile human cerebral cortex
Alexander G. Huth, Wendy A. de Heer, Thomas L. Griffiths, Frédéric E. Theunissen, and Jack L. Gallant · 2016
Earlier work this paper cites.
Generative adversarial networks for reconstructing natural images from brain activity
K. Seeliger, U. Güçlü, L. Ambrogioni, Y. Güçlütürk, and M.A.J. van Gerven · 2018
Earlier work this paper cites.
GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium, January 2018
Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter · 2018
Earlier work this paper cites.
End-to-End Deep Image Reconstruction From Human Brain Activity
Guohua Shen, Kshitij Dwivedi, Kei Majima, Tomoyasu Horikawa, and Yukiyasu Kamitani · 2019
Earlier work this paper cites.
Language Models are Unsupervised Multitask Learners
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever · 2019
Cited alongside, same era.
Measuring shared responses across subjects using intersubject correlation
Samuel A Nastase, Valeria Gazzola, Uri Hasson, and Christian Keysers · 2019
Cited alongside, same era.
Mixco: Mix-up contrastive learning for visual representation
Sungnyun Kim, Gihun Lee, Sangmin Bae, and Seyoung Yun · 2020
Cited alongside, same era.
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction, September 2020
Leland McInnes, John Healy, and James Melville · 2020
Cited alongside, same era.
Learning Transferable Visual Models From Natural Language Supervision, February 2021
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever · 2021
Weixin Liang, Yuhui Zhang, Yongchan Kwon, Serena Yeung, and James Zou · 2022
Later among the works it cites.
What the DAAM: Interpreting Stable Diffusion Using Cross Attention, December 2022
Raphael Tang, Linqing Liu, Akshat Pandey, Zhiying Jiang, Gefei Yang, Karun Kumar, Pontus Stenetorp, Jimmy Lin, and Ferhan Ture · 2022
Later among the works it cites.
Improving visual image reconstruction from human brain activity using latent diffusion models via multiple decoded inputs, 2023
Yu Takagi and Shinji Nishimoto · 2023
Later among the works it cites.
Furkan Ozcelik and Rufin VanRullen · 2023
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
OpenCLIP, July 2021
Gabriel Ilharco, Mitchell Wortsman, Ross Wightman, Cade Gordon, Nicholas Carlini, Rohan Taori, Achal Dave, Vaishaal Shankar, Hongseok Namkoong, John Miller, Hannaneh Hajishirzi, Ali Farhadi, and Ludwig Schmidt · 2021
Cited alongside, same era.
Learning shared neural manifolds from multi-subject FMRI data, December 2021
Jessie Huang, Erica L. Busch, Tom Wallenstein, Michal Gerasimiuk, Andrew Benz, Guillaume Lajoie, Guy Wolf, Nicholas B. Turk-Browne, and Smita Krishnaswamy · 2021
Cited alongside, same era.
Hybrid hyperalignment: A single high-dimensional model of shared information embedded in cortical patterns of response and functional connectivity
Erica L. Busch, Lukas Slipski, Ma Feilong, J. Swaroop Guntupalli, Matteo Visconti di Oleggio Castello, Jeremy F. Huckins, Samuel A. Nastase, M. Ida Gobbini, Tor D. Wager, and James V. Haxby · 2021
Cited alongside, same era.
A massive 7T fMRI dataset to bridge cognitive and computational neuroscience
Emily J. Allen, Ghislain St-Yves, Yihan Wu, Jesse L. Breedlove, Logan T. Dowdle, Brad Caron, Franco Pestilli, Ian Charest, J. Benjamin Hutchinson, Thomas Naselaris, and Kendrick Kay · 2021
Cited alongside, same era.
High-Resolution Image Synthesis with Latent Diffusion Models, April 2022
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer · 2022
Cited alongside, same era.
A massive 7T fMRI dataset to bridge cognitive neuroscience and artificial intelligence
Emily J. Allen, Ghislain St-Yves, Yihan Wu, Jesse L. Breedlove, Jacob S. Prince, Logan T. Dowdle, Matthias Nau, Brad Caron, Franco Pestilli, Ian Charest, J. Benjamin Hutchinson, Thomas Naselaris, and Kendrick Kay · 2022
Cited alongside, same era.
High-resolution image reconstruction with latent diffusion models from human brain activity
Yu Takagi and Shinji Nishimoto · 2022
Cited alongside, same era.
Zijin Gu, Keith Jamison, Amy Kuceyeski, and Mert Sabuncu · 2023
Later among the works it cites.
Reconstructing the Mind’s Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priors
Paul Scotti, Atmadeep Banerjee, Jimmie Goode, Stepan Shabalin, Alex Nguyen, Ethan Cohen, Aidan Dempster, Nathalie Verlinde, Elad Yundler, David Weisberg, Kenneth Norman, and Tanishq Abraham · 2023
Later among the works it cites.
Reconstructing seen images from human brain activity via guided stochastic search
Reese Kneeland, Jordyn Ojeda, Ghislain St-Yves, and Thomas Naselaris · 2023
Later among the works it cites.
Aligning brain functions boosts the decoding of visual semantics in novel subjects, December 2023
Alexis Thual, Yohann Benchetrit, Felix Geilert, Jérémy Rapin, Iurii Makarov, Hubert Banville, and Jean-Rémi King · 2023
Later among the works it cites.
Contrast, Attend and Diffuse to Decode High-Resolution Images from Brain Activities, December 2023
Jingyuan Sun, Mingxiao Li, Zijiao Chen, Yunhao Zhang, Shaonan Wang, and Marie-Francine Moens · 2023
Later among the works it cites.
Weijian Mai and Zhijun Zhang · 2023
Later among the works it cites.
DREAM: Visual Decoding from Reversing Human Visual System, October 2023
Weihao Xia, Raoul de Charette, Cengiz Öztireli, and Jing-Hao Xue · 2023
Later among the works it cites.
Versatile Diffusion: Text, Images and Variations All in One Diffusion Model, March 2023
Xingqian Xu, Zhangyang Wang, Eric Zhang, Kai Wang, and Humphrey Shi · 2023
Later among the works it cites.
IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models, August 2023
Hu Ye, Jun Zhang, Sibo Liu, Xiao Han, and Wei Yang · 2023
Later among the works it cites.
SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis, July 2023
Dustin Podell, Zion English, Kyle Lacey, Andreas Blattmann, Tim Dockhorn, Jonas Müller, Joe Penna, and Robin Rombach · 2023
Later among the works it cites.
Diffusion with Offset Noise, 2023
Nicholas Guttenberg · 2023
Later among the works it cites.
Learnable latent embeddings for joint behavioural and neural analysis
Steffen Schneider, Jin Hwa Lee, and Mackenzie Weygandt Mathis · 2023
Later among the works it cites.
Brain decoding: toward real-time reconstruction of visual perception
Yohann Benchetrit, Hubert Banville, and Jean-Remi King · 2023
Later among the works it cites.
Memory Encoding Model, August 2023
Huzheng Yang, James Gee, and Jianbo Shi · 2023
Later among the works it cites.
A Parameter-efficient Multi-subject Model for Predicting fMRI Activity, August 2023
Connor Lane and Gregory Kiar · 2023
Later among the works it cites.
Semantic reconstruction of continuous language from non-invasive brain recordings
Jerry Tang, Amanda LeBel, Shailee Jain, and Alexander G. Huth · 2023
Later among the works it cites.
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models
Junnan Li, Dongxu Li, Silvio Savarese, and Steven Hoi · 2023
Later among the works it cites.
Sigmoid Loss for Language Image Pre-Training, September 2023
Xiaohua Zhai, Basil Mustafa, Alexander Kolesnikov, and Lucas Beyer · 2023
Later among the works it cites.
Umap visualization of CLIP text feature, July 2023
Ken Shirakawa · 2023
Later among the works it cites.
Brain Dissection: fMRI-trained Networks Reveal Spatial Selectivity in the Processing of Natural Images, May 2023
Gabriel H. Sarch, Michael J. Tarr, Katerina Fragkiadaki, and Leila Wehbe · 2023
Later among the works it cites.
Getting aligned on representational alignment, October 2023
Ilia Sucholutsky, Lukas Muttenthaler, Adrian Weller, Andi Peng, Andreea Bobu, Been Kim, Bradley C. Love, Erin Grant, Iris Groen, Jascha Achterberg, Joshua B. Tenenbaum, Katherine M. Collins, Katherine L. Hermann, Kerem Oktar, Klaus Greff, Martin N. Hebart, Nori Jacoby, Qiuyi Zhang, Raja Marjieh, Robert Geirhos, Sherol Chen, Simon Kornblith, Sunayana Rane, Talia Konkle, Thomas P. O’Connell, Thomas Unterthiner, Andrew K. Lampinen, Klaus-Robert Müller, Mariya Toneva, and Thomas L. Griffiths · 2023
Later among the works it cites.
Common Diffusion Noise Schedules and Sample Steps are Flawed, January 2024
Shanchuan Lin, Bingchen Liu, Jiashi Li, and Xiao Yang · 2024
Closest in time.
The Faiss library
Matthijs Douze, Alexandr Guzhva, Chengqi Deng, Jeff Johnson, Gergely Szilvasy, Pierre-Emmanuel Mazaré, Maria Lomeli, Lucas Hosseini, and Hervé Jégou · 2024
Closest in time.
Hyperalignment: Modeling shared information encoded in idiosyncratic cortical topographies
James V Haxby, J Swaroop Guntupalli, Samuel A Nastase, and Ma Feilong · 2050
Closest in time.
Improving the accuracy of single-trial fMRI response estimates using GLMsingle
Jacob S Prince, Ian Charest, Jan W Kurzawski, John A Pyles, Michael J Tarr, and Kendrick N Kay · 2050
Closest in time.