无需训练,实时发现事件流中的运动物体。
Real-time Unsupervised Object Discovery from Asynchronous Event Streams

- 基于时空概率滤波与默顿编码聚类,实现无监督运动物体发现。
- 在多个数据集上准确率最高,执行时间低于传统方法。
- 适合低延迟、资源受限的实时视觉感知场景。
事件相机以微秒级分辨率捕捉像素级亮度变化,生成高度稀疏的异步数据流。针对对延迟敏感的视觉感知环境,我们提出一种轻量级、无需训练的框架,通过时空聚类实现运动物体的发现。核心贡献包括:第一,线性时间的时空概率事件滤波器(SPEF),引入自适应事件接受阈值,有效区分显著运动结构与背景噪声;第二,事件默顿编码聚类(EMCC)模块,跳过昂贵的距离矩阵计算,高效分组事件以实现无监督物体发现。在E-MLB数据集上,SPEF在经典滤波方法中表现最佳,且不需离线训练即可媲美学习型方法。在物体发现任务中,EMCC在FRED和eTraM数据集上达到最高准确率与最低执行时间,显著优于传统密度聚类基线。本工作为事件数据中的经典物体发现建立了新基准,提供高可扩展、无需训练的解决方案。代码已开源。
原文摘要 · Abstract (English)
Event cameras capture pixel-level intensity changes with microsecond resolution to produce highly sparse asynchronous data streams. For visual perception in latency-critical environments, we propose a lightweight, training-free framework for discovery of moving objects based on spatio-temporal clustering. This framework is driven by two core contributions. First, a linear-time Spatio-temporal Probabilistic Event Filter (SPEF) that introduces an adaptive event acceptance threshold to distinguish salient motion structures from background noise. Second, an Event Morton Code Clustering (EMCC) module that bypasses expensive distance matrix computation to efficiently group events for unsupervised discovery of moving objects. On the E-MLB dataset benchmark, SPEF achieves the best denoising performance among classical filtering methods and remains competitive with learning-based approaches without requiring any offline training. On object discovery, EMCC achieves the highest overall accuracy and lowest execution time across the FRED and eTraM datasets, outperforming established density-based clustering baselines by a substantial margin. Overall, this work establishes a new performance benchmark for classical object discovery in event data, providing a highly scalable, training-free solution for resource-constrained visual perception. The code is available at https://github.com/PrathamShenwai/SPEF_EMCC
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。