SSTFormer: Bridging Spiking Neural Network and Memory Support Transformer for Frame-Event based Recognition

Understand

Event camera-based pattern recognition is a newly arising research topic in recent years.

• Current researchers usually transform the event streams into images, graphs, or voxels, and adopt deep neural networks for event-based classification.
• Although good performance can be achieved on simple event recognition datasets, however, their results may be still limited due to the following two issues.
• Firstly, they adopt spatial sparse event streams for recognition only, which may fail to capture the color and detailed texture information well.