Fetching the paper…
Reading the bibliography…
Benefiting from the event-driven and sparse spiking characteristics of the brain, spiking neural networks (SNNs) are becoming an energy-efficient alternative to artificial neural networks (ANNs).
J. Moran and R. Desimone, “Selective attention gates visual processing in the extrastriate cortex,” Science , vol. 229, no. 4715, pp. 782–784, 1985
1985
Earlier work this paper cites.
H. Spitzer, R. Desimone, and J. Moran, “Increased attention enhances both behavioral and neuronal performance,” Science , vol. 240, no. 4850, pp. 338–340, 1988
1988
Earlier work this paper cites.
W. Maass, “Networks of spiking neurons: The third generation of neural network models,” Neural Networks , vol. 10, no. 9, pp. 1659–1671, 1997
1997
Earlier work this paper cites.
L. Itti, C. Koch, and E. Niebur, “A model of saliency-based visual attention for rapid scene analysis,” IEEE Transactions on pattern analysis and machine intelligence , vol. 20, no. 11, pp. 1254–1259, 1998
1998
Earlier work this paper cites.
F. Engert and T. Bonhoeffer, “Dendritic spine changes associated with hippocampal long-term synaptic plasticity,” Nature , vol. 399, no. 6731, pp. 66–70, 1999
1999
Earlier work this paper cites.
S. B. Laughlin and T. J. Sejnowski, “Communication in neuronal networks,” Science , vol. 301, no. 5641, pp. 1870–1874, 2003
2003
Earlier work this paper cites.
S. Chevallier and P. Tarroux, “Covert attention with a spiking neural network,” in International conference on computer vision systems . Springer, 2008, pp. 56–65
2008
Earlier work this paper cites.
J. F. Mitchell, K. A. Sundberg, and J. H. Reynolds, “Spatial attention decorrelates intrinsic activity fluctuations in macaque area v4,” Neuron , vol. 63, no. 6, pp. 879–888, 2009
2009
Earlier work this paper cites.
J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, “Imagenet: A large-scale hierarchical image database,” in 2009 IEEE conference on computer vision and pattern recognition . Ieee, 2009, pp. 248–255
2009
Earlier work this paper cites.
K. C. Neokleous, M. N. Avraamides, C. K. Neocleous, and C. N. Schizas, “Selective attention and consciousness: investigating their relation through computational modelling,” Cognitive Computation , vol. 3, no. 1, pp. 321–331, 2011
2011
Earlier work this paper cites.
X. Glorot, A. Bordes, and Y. Bengio, “Deep sparse rectifier neural networks,” in Proceedings of the fourteenth international conference on artificial intelligence and statistics . JMLR Workshop and Conference Proceedings, 2011, pp. 315–323
2011
Earlier work this paper cites.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” Advances in neural information processing systems , vol. 25, 2012
2012
Earlier work this paper cites.
F. Briggs, G. R. Mangun, and W. M. Usrey, “Attention enhances synaptic efficacy and the signal-to-noise ratio in neural circuits,” Nature , vol. 499, no. 7459, pp. 476–480, 2013
2013
Earlier work this paper cites.
2014
Earlier work this paper cites.
P. A. Merolla, J. V. Arthur, R. Alvarez-Icaza, A. S. Cassidy, J. Sawada, F. Akopyan, B. L. Jackson, N. Imam, C. Guo, Y. Nakamura et al. , “A million spiking-neuron integrated circuit with a scalable communication network and interface,” Science , vol. 345, no. 6197, pp. 668–673, 2014
2014
Earlier work this paper cites.
M. Horowitz, “1.1 computing’s energy problem (and what we can do about it),” in 2014 IEEE International Solid-State Circuits Conference Digest of Technical Papers (ISSCC) . IEEE, 2014, pp. 10–14
2014
Earlier work this paper cites.
J. Hirschberg and C. D. Manning, “Advances in natural language processing,” Science , vol. 349, no. 6245, pp. 261–266, 2015
2015
Earlier work this paper cites.
S. Ioffe and C. Szegedy, “Batch normalization: Accelerating deep network training by reducing internal covariate shift,” in International conference on machine learning . PMLR, 2015, pp. 448–456
2015
Earlier work this paper cites.
J. H. Maunsell, “Neuronal mechanisms of visual attention,” Annual review of vision science , vol. 1, pp. 373–391, 2015
2015
Earlier work this paper cites.
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2016, pp. 770–778
2016
Earlier work this paper cites.
D. Silver, A. Huang, C. J. Maddison, A. Guez, L. Sifre, G. Van Den Driessche, J. Schrittwieser, I. Antonoglou, V. Panneershelvam, M. Lanctot et al. , “Mastering the game of go with deep neural networks and tree search,” Nature , vol. 529, no. 7587, pp. 484–489, 2016
2016
Earlier work this paper cites.
B. Zhou, A. Khosla, A. Lapedriza, A. Oliva, and A. Torralba, “Learning deep features for discriminative localization,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2016, pp. 2921–2929
2016
Earlier work this paper cites.
A. Esteva, B. Kuprel, R. A. Novoa, J. Ko, S. M. Swetter, H. M. Blau, and S. Thrun, “Dermatologist-level classification of skin cancer with deep neural networks,” Nature , vol. 542, no. 7639, pp. 115–118, 2017
2017
Earlier work this paper cites.
V. Sze, Y.-H. Chen, T.-J. Yang, and J. S. Emer, “Efficient processing of deep neural networks: A tutorial and survey,” Proceedings of the IEEE , vol. 105, no. 12, pp. 2295–2329, 2017
2017
Earlier work this paper cites.
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” Advances in neural information processing systems , vol. 30, 2017
2017
Cited alongside, same era.
A. Amir, B. Taba, D. Berg, T. Melano, J. McKinstry, C. Di Nolfo, T. Nayak, A. Andreopoulos, G. Garreau, M. Mendoza et al. , “A low power, fully event-based gesture recognition system,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , 2017, pp. 7243–7252
2017
Cited alongside, same era.
F. Wang, M. Jiang, C. Qian, S. Yang, C. Li, H. Zhang, X. Wang, and X. Tang, “Residual attention network for image classification,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2017, pp. 3156–3164
2017
Cited alongside, same era.
M. Davies, N. Srinivasa, T.-H. Lin, G. Chinya, Y. Cao, S. H. Choday, G. Dimou, P. Joshi, N. Imam, S. Jain et al. , “Loihi: A neuromorphic manycore processor with on-chip learning,” Ieee Micro , vol. 38, no. 1, pp. 82–99, 2018
H. Zheng, Y. Wu, L. Deng, Y. Hu, and G. Li, “Going deeper with directly-trained larger spiking neural networks,” Proceedings of the AAAI Conference on Artificial Intelligence , vol. 35, pp. 11 062–11 070, 2021
2021
Later among the works it cites.
W. Fang, Z. Yu, Y. Chen, T. Huang, T. Masquelier, and Y. Tian, “Deep residual learning in spiking neural networks,” Thirty-fifth Conference on Neural Information Processing Systems (NIPS2021) , 2021
2021
Later among the works it cites.
Z. Liu, Y. Lin, Y. Cao, H. Hu, Y. Wei, Z. Zhang, S. Lin, and B. Guo, “Swin transformer: Hierarchical vision transformer using shifted windows,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2021, pp. 10 012–10 022
2021
Later among the works it cites.
L. Yuan, Y. Chen, T. Wang, W. Yu, Y. Shi, Z.-H. Jiang, F. E. Tay, J. Feng, and S. Yan, “Tokens-to-token vit: Training vision transformers from scratch on imagenet,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2021, pp. 558–567
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
2018
Cited alongside, same era.
J. Hu, L. Shen, and G. Sun, “Squeeze-and-excitation networks,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2018, pp. 7132–7141
2018
Cited alongside, same era.
S. Woo, J. Park, J.-Y. Lee, and I. S. Kweon, “Cbam: Convolutional block attention module,” in Proceedings of the European conference on computer vision (ECCV) , 2018, pp. 3–19
2018
Cited alongside, same era.
Y. Wu, L. Deng, G. Li, J. Zhu, and L. Shi, “Spatio-temporal backpropagation for training high-performance spiking neural networks,” Frontiers in neuroscience , vol. 12, p. 331, 2018
2018
Cited alongside, same era.
S. B. Shrestha and G. Orchard, “Slayer: spike layer error reassignment in time,” in Proceedings of the 32nd International Conference on Neural Information Processing Systems , 2018, pp. 1419–1428
2018
Cited alongside, same era.
K. Roy, A. Jaiswal, and P. Panda, “Towards spike-based machine intelligence with neuromorphic computing,” Nature , vol. 575, no. 7784, pp. 607–617, 2019
2019
Cited alongside, same era.
J. Pei, L. Deng et al. , “Towards artificial general intelligence with hybrid tianjic chip architecture,” Nature , vol. 572, no. 7767, pp. 106–111, 2019
2019
Cited alongside, same era.
E. O. Neftci, H. Mostafa, and F. Zenke, “Surrogate gradient learning in spiking neural networks: Bringing the power of gradient-based optimization to spiking neural networks,” IEEE Signal Processing Magazine , vol. 36, no. 6, pp. 51–63, 2019
2019
Cited alongside, same era.
H. Rebecq, R. Ranftl, V. Koltun, and D. Scaramuzza, “High speed and high dynamic range video with an event camera,” IEEE transactions on pattern analysis and machine intelligence , pp. 1–1, 2019
2019
Cited alongside, same era.
2021
Later among the works it cites.
S. Kundu, G. Datta, M. Pedram, and P. A. Beerel, “Spike-thrift: Towards energy-efficient deep spiking neural networks by limiting spiking activity via attention-guided compression,” in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , 2021, pp. 3953–3962
2021
Later among the works it cites.
L. Yang, R.-Y. Zhang, L. Li, and X. Xie, “Simam: A simple, parameter-free attention module for convolutional neural networks,” in International Conference on Machine Learning . PMLR, 2021, pp. 11 863–11 874
2021
Later among the works it cites.
J. Wu, C. Xu, X. Han, D. Zhou, M. Zhang, H. Li, and K. C. Tan, “Progressive tandem learning for pattern recognition with deep spiking neural networks,” IEEE Transactions on Pattern Analysis and Machine Intelligence , 2021
2021
Later among the works it cites.
C. Stöckl and W. Maass, “Optimized spiking neurons can classify images with high accuracy through temporal coding with two spikes,” Nature Machine Intelligence , vol. 3, no. 3, pp. 230–238, 2021
2021
Later among the works it cites.
Y. Li, S. Deng, X. Dong, R. Gong, and S. Gu, “A free lunch from ann: Towards efficient, accurate spiking neural networks calibration,” in International Conference on Machine Learning . PMLR, 2021, pp. 6316–6325
2021
Later among the works it cites.
W. Fang, Z. Yu, Y. Chen, T. Masquelier, T. Huang, and Y. Tian, “Incorporating learnable membrane time constant to enhance learning of spiking neural networks,” in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) , October 2021, pp. 2661–2671
2021
Later among the works it cites.
M. Yao, H. Gao, G. Zhao, D. Wang, Y. Lin, Z. Yang, and G. Li, “Temporal-wise attention spiking neural networks for event streams classification,” in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) , October 2021, pp. 10 221–10 230
2021
Later among the works it cites.
Y. Wang, X. Zhang, Y. Shen, B. Du, G. Zhao, L. C. Cui Lizhen, and H. Wen, “Event-stream representation for human gaits identification using deep neural networks,” IEEE Transactions on Pattern Analysis and Machine Intelligence , pp. 1–1, 2021
2021
Later among the works it cites.
S. Kundu, M. Pedram, and P. A. Beerel, “Hire-snn: Harnessing the inherent robustness of energy-efficient deep spiking neural networks by training with crafted input noise,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2021, pp. 5209–5218
2021
Later among the works it cites.
B. Yin, F. Corradi, and S. M. Bohté, “Accurate and efficient time-domain classification with adaptive spiking recurrent neural networks,” Nature Machine Intelligence , vol. 3, no. 10, pp. 905–913, 2021
2021
Later among the works it cites.
2021
Later among the works it cites.
2021
Later among the works it cites.
Y. Kim and P. Panda, “Visual explanations from spiking neural networks using inter-spike intervals,” Scientific reports , vol. 11, no. 1, pp. 1–14, 2021
2021
Later among the works it cites.
L. Deng, Y. Wu, Y. Hu, L. Liang, G. Li, X. Hu, Y. Ding, P. Li, and Y. Xie, “Comprehensive snn compression using admm optimization and activity regularization,” IEEE Transactions on Neural Networks and Learning Systems , pp. 1–15, 2021
2021
Later among the works it cites.
K. Han, Y. Wang, H. Chen, X. Chen, J. Guo, Z. Liu, Y. Tang, A. Xiao, C. Xu, Y. Xu, Z. Yang, Y. Zhang, and D. Tao, “A survey on vision transformer,” IEEE Transactions on Pattern Analysis and Machine Intelligence , pp. 1–1, 2022
2022
Closest in time.
M.-H. Guo, T.-X. Xu, J.-J. Liu, Z.-N. Liu, P.-T. Jiang, T.-J. Mu, S.-H. Zhang, R. R. Martin, M.-M. Cheng, and S.-M. Hu, “Attention mechanisms in computer vision: A survey,” Computational Visual Media , pp. 1–38, 2022
2022
Closest in time.
T. Bu, J. Ding, Z. Yu, and T. Huang, “Optimized potential initialization for low-latency spiking neural networks,” Proceedings of the AAAI Conference on Artificial Intelligence , 2022
2022
Closest in time.
S. Deng, Y. Li, S. Zhang, and S. Gu, “Temporal efficient training of spiking neural network via gradient re-weighting,” in International Conference on Learning Representations , 2022
2022
Closest in time.
2022
Closest in time.
H.-H. Lien and T.-S. Chang, “Sparse compressed spiking neural network accelerator for object detection,” IEEE Transactions on Circuits and Systems I: Regular Papers , 2022
2022
Closest in time.