arXiv:2412.20803cs.CV2024-12被引 6

提出SECNet网络,用事件云表示实现高效高分辨率事件分类

Scalable Event Cloud Network for Event-based Classification

  • 用事件云结构融合极性信息,避免传统输入层处理
  • 通过傅里叶变换在频域提取特征,减少计算量并支持长序列
  • 在10个数据集上验证,兼具可扩展性与高效性,适合实时事件处理

事件相机是受生物启发的传感器,受到产业界和学术界的广泛关注。主流方法采用帧或体素表示,虽性能良好,但引入了耗时转换、模型庞大以及损失细粒度时间信息的问题。相比之下,点云表示虽具潜力,但在抽象高空间分辨率和长时序事件特征方面可扩展性有限。本文提出一种名为SECNet的可扩展网络,利用事件云表示。SECNet通过创新事件分组与采样模块,在结构层面融合极性信息,而非仅在输入层处理。为应对事件数量激增,该网络在频域进行特征提取,借助傅里叶变换,不仅显著抑制乘加操作爆炸,还有效抽象时空特征。我们在十个事件数据集上进行了广泛实验,验证了SECNet的可扩展性、有效性与高效性。代码将公开于:https://github.com/rhwxmx/SECNet_ICML。

原文摘要 · Abstract (English)

Event cameras are biologically inspired sensors garnering significant attention from both industry and academia. Mainstream methods favor frame and voxel representations, which reach a satisfactory performance while introducing time-consuming transformations, bulky models, and sacrificing fine-grained temporal information. Alternatively, Point Cloud representation demonstrates promise in addressing the mentioned weaknesses, but it has limited scalability in abstracting features of higher spatial resolution and longer temporal sequence events. In this paper, we propose a Scalable Network named SECNet to leverage Event Cloud representation. SECNet integrates polarity at the structural level by innovating the Event-based Group and Sampling module rather than only at the input level. To accommodate the surge in the number of events, SECNet embraces feature extraction in the frequency domain via the Fourier transform.This approach not only substantially extinguishes the explosion of Multiply Accumulate Operations but also effectively abstracts spatio-temporal features. We conducted extensive experiments on \textbf{ten} event-based datasets, and substantiate the scalability, effectiveness, and efficiency of SECNet. Our code will be available at: https://github.com/rhwxmx/SECNet_ICML.

事件相机点云频域处理可扩展性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。