arXiv:2409.08953cs.CV2024-09ECCV被引 3

压缩事件数据量十倍,仍能保持高分类准确率。

Pushing the boundaries of event subsampling in event-based video classification using CNNs

论文配图:Pushing the boundaries of event subsampling in event-based video classification using CNNs
图 1 · 摘自论文原文
  • 用卷积网络研究事件数据降采样对分类的影响。
  • 事件数减十倍,准确率下降极小,但训练更不稳定。
  • 发现模型对超参数敏感是主因,非仅信息丢失。

事件相机具备低功耗视觉感知能力,适合边缘设备应用。然而其高事件率受高时间细节驱动,限制了带宽与计算资源。在边缘AI应用中,确定任务所需的最小事件量可降低事件率,提升带宽、内存与处理效率。本文研究卷积神经网络(CNN)在事件数据降采样下的分类准确率影响。令人惊讶的是,多个数据集上事件数可减少一个数量级,准确率仅轻微下降,揭示了精度与事件率权衡的边界。此外,高降采样率下准确率下降不仅源于事件信息损失,还因CNN在高度降采样场景中训练困难,超参数敏感性显著增强。我们提出一种新指标,量化多个事件分类数据集中的训练不稳定性,并分析网络权重梯度以揭示此现象成因。

原文摘要 · Abstract (English)

Event cameras offer low-power visual sensing capabilities ideal for edge-device applications. However, their high event rate, driven by high temporal details, can be restrictive in terms of bandwidth and computational resources. In edge AI applications, determining the minimum amount of events for specific tasks can allow reducing the event rate to improve bandwidth, memory, and processing efficiency. In this paper, we study the effect of event subsampling on the accuracy of event data classification using convolutional neural network (CNN) models. Surprisingly, across various datasets, the number of events per video can be reduced by an order of magnitude with little drop in accuracy, revealing the extent to which we can push the boundaries in accuracy vs. event rate trade-off. Additionally, we also find that lower classification accuracy in high subsampling rates is not solely attributable to information loss due to the subsampling of the events, but that the training of CNNs can be challenging in highly subsampled scenarios, where the sensitivity to hyperparameters increases. We quantify training instability across multiple event-based classification datasets using a novel metric for evaluating the hyperparameter sensitivity of CNNs in different subsampling settings. Finally, we analyze the weight gradients of the network to gain insight into this instability.

事件相机降采样边缘计算训练不稳定性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。