arXiv:2504.00370cs.CVcs.LG2025-04

用轻量注意力框架提升事件相机目标识别性能

Spatiotemporal Attention Learning Framework for Event-Driven Object Recognition

  • 在VGG中加入空间-时间注意力模块,优化事件流处理
  • 在CIFAR10-DVS上达76.4%准确率(预训练)和71.3%(未预训练)
  • 参数减少2.3%,适合无迁移学习的实用场景

基于事件的视觉传感器模仿生物神经结构,异步捕捉像素级亮度变化,生成含位置、极性和时间戳信息的稀疏事件流。这类神经形态传感器在动态范围、延迟和能效方面具有显著优势,天然克服了传统摄像头的运动模糊与冗余背景问题,特别适用于动态视觉任务。尽管近期研究提出了日益复杂的事件感知架构,但其计算开销与参数复杂度限制了实际部署。本文提出一种新型时空注意力学习框架,用于事件驱动的目标识别,采用增强卷积块注意力模块(CBAM)的VGG网络。该方法在性能上媲美最先进的基于ResNet的方法,同时相比原始VGG模型参数量减少2.3%。具体而言,在CIFAR10-DVS数据集上,其预训练版本达到最高Top-1准确率76.4%,未预训练版本为71.3%;在N-Caltech101上未预训练准确率达72.4%。结果表明,该方法在缺乏预训练权重时仍具强鲁棒性,适用于无法使用迁移学习的场景。此外,该方法降低了对数据增强的依赖。标准事件数据集上的实验验证了框架在真实应用中的高效性与有效性。

原文摘要 · Abstract (English)

Event-based vision sensors, inspired by biological neural systems, asynchronously capture local pixel-level intensity changes as a sparse event stream containing position, polarity, and timestamp information. These neuromorphic sensors offer significant advantages in dynamic range, latency, and power efficiency. Their working principle inherently addresses traditional camera limitations such as motion blur and redundant background information, making them particularly suitable for dynamic vision tasks. While recent works have proposed increasingly complex event-based architectures, the computational overhead and parameter complexity of these approaches limit their practical deployment. This paper presents a novel spatiotemporal learning framework for event-based object recognition, utilizing a VGG network enhanced with Convolutional Block Attention Module (CBAM). Our approach achieves comparable performance to state-of-the-art ResNet-based methods while reducing parameter count by 2.3% compared to the original VGG model. Specifically, it outperforms ResNet-based methods like MVF-Net, achieving the highest Top-1 accuracy of 76.4% (pretrained) and 71.3% (not pretrained) on CIFAR10-DVS, and 72.4% (not pretrained) on N-Caltech101. These results highlight the robustness of our method when pretrained weights are not used, making it suitable for scenarios where transfer learning is unavailable. Moreover, our approach reduces reliance on data augmentation. Experimental results on standard event-based datasets demonstrate the framework's efficiency and effectiveness for real-world applications.

事件视觉注意力机制轻量化模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。