arXiv:2605.08825cs.CV2026-05

用时空聚合与超图推理提升事件相机的物体检测精度

Rethinking Event-Based Object Detection through Representation-Level Temporal Aggregation and Model-Level Hypergraph Reasoning

论文配图:Rethinking Event-Based Object Detection through Representation-Level Temporal Aggregation and Model-Level Hypergraph Reasoning
图 1 · 摘自论文原文
  • 构建紧凑的三通道时序表示,显式编码事件时间信息
  • 在eTraM数据集上提升3.0 mAP,显著改善稀疏事件下的检测性能
  • 适合做高速运动、低光照场景下高实时性目标检测的研究者

事件相机具备微秒级时间分辨率、低延迟和高动态范围,适用于快速运动和复杂光照条件下的感知。然而,现有事件基物体检测(EOD)方法在表征和模型层面均存在局限:先前的事件表示通常通过冗余结构间接编码时间信息,而检测模型难以将零散的事件响应有效聚合为连贯的高层次目标特征。为此,我们提出统一的EOD框架Ev-DTAD,融合表征级时序编码与模型级超图关系推理。具体地,引入层次化时序聚合(HTA),一种紧凑的三通道伪RGB表示,显式嵌入窗口内与窗口间事件的时间信息;为进一步增强稀疏事件响应下的检测能力,提出频敏超图时序融合(FHTF),通过时序演化建模与高阶关系推理优化多尺度事件特征。在Gen1(+0.8 mAP)、1Mpx/Gen4(+0.5 mAP)和eTraM(+3.0 mAP)上的大量实验表明,Ev-DTAD实现了优异的精度-效率平衡,验证了紧凑时序表征与超图关系推理之间的互补性。

原文摘要 · Abstract (English)

Event cameras provide microsecond-level temporal resolution, low latency, and high dynamic range, offering potential for perception under fast motion and challenging illumination conditions. However, existing Event-based Object Detection (EOD) methods face limitations at both the representation and model levels: prior event representations usually encode temporal information indirectly through redundant structures, while detection models struggle to explicitly aggregate fragmented event responses into coherent high-order object features. To address these limitations, we present \textbf{Event Dual Temporal-Relational Aggregation Detector (Ev-DTAD)}, a unified EOD framework that integrates representation-level temporal encoding with model-level temporal-hypergraph reasoning. Specifically, we introduce \textbf{Hierarchical Temporal Aggregation (HTA)}, a compact three-channel pseudo-RGB representation that explicitly embeds temporal information across intra- and inter-window events. To further enhance detection under sparse and fragmented event responses, we propose \textbf{Frequency-aware Hypergraph Temporal Fusion (FHTF)}, which refines multi-scale event features through temporal evolution modeling and high-order relational reasoning. Extensive experiments on Gen1 (\textbf{+0.8 mAP}), 1Mpx/Gen4 (\textbf{+0.5 mAP}), and eTraM (\textbf{+3.0 mAP}) demonstrate that Ev-DTAD achieves a competitive accuracy--efficiency trade-off, validating the complementarity between compact temporal representation and temporal-hypergraph feature reasoning (Fig.~\ref{fig:bubble}). The code is available at: https://github.com/meisenwang/Ev-DTAD.

事件相机目标检测时序聚合超图推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。