arXiv:2504.16616cs.CV2025-04被引 1

首次融合欧氏与双曲空间,提升事件流感知的层次结构建模能力。

EHGCN: Hierarchical Euclidean-Hyperbolic Fusion via Motion-Aware GCN for Hybrid Event Stream Perception

  • 用多尺度体素与高斯建模筛选关键事件,抑制噪声干扰。
  • 基于马尔可夫随机场优化运动感知超边,捕捉一致运动模式。
  • 结合局部欧氏与全局双曲空间,实现事件流的混合感知建模。

事件相机具有微秒级时间分辨率和极高动态范围(HDR),能生成高速事件流用于感知任务。近期基于图神经网络(GNN)的方法在事件感知中展现出潜力,但通常依赖欧氏空间中的简单成对节点连接,难以捕捉长程依赖并忠实表征事件流的固有层次结构。为此,我们提出EHGCN,据我们所知是首个联合在欧氏与双曲空间建模事件流的双空间感知方法。通过引入双曲几何,EHGCN能够自然捕捉非均匀、运动驱动事件流的各向异性与层次结构。具体而言,首先提出基于多尺度体素网格与高斯分布建模的分布感知事件筛选方法,保留判别性事件同时衰减混沌噪声;其次设计基于马尔可夫随机场(MRF)优化的运动感知超边生成方案,通过最小化运动一致性能量函数,显式捕捉短时窗内的一致全局运动模式,消除跨目标虚假关联,并提供关键拓扑先验以捕获事件间的长程依赖;最后提出欧氏-双曲图卷积网络,分别在局部欧氏空间与全局双曲空间中稠密聚合与层次建模视网膜事件,实现混合事件感知。在目标检测与识别等事件感知任务上的大量实验验证了该方法的有效性。代码将开源于https://github.com/ev-lluo/EHGCN。

原文摘要 · Abstract (English)

Event cameras, characterized by microsecond temporal resolution and very High Dynamic Range (HDR), emit high-speed event streams for perception tasks. In recent advancements, Graph Neural Networks (GNNs)-based methods show great potential in event perception. However, they typically rely on straightforward pairwise node connectivity in Euclidean space where they struggle to capture long-range dependencies and faithfully characterize the inherent hierarchical structures of event streams. To this end, we propose EHGCN, a dual-space event perception approach that, to the best of our knowledge, is the first to jointly model event streams in Euclidean and hyperbolic spaces. By introducing hyperbolic geometry into event stream perception, EHGCN enables to naturally capture the anisotropic and hierarchical structures of non-uniform, motion-driven event streams. Specifically, we first introduce a distribution-aware event sifting method based on multi-scale voxel grids and Gaussian distribution modeling, retaining discriminative events while attenuating chaotic noise. Then, we present a Markov Random Field (MRF)-optimized motion-aware hyperedge generation scheme, which minimizes a motion consistency energy function to explicitly capture consistent global motion patterns within short time intervals, thereby eliminating cross-target spurious associations and providing critically topological priors while capturing long-range dependencies among events. Finally, we propose a Euclidean-hyperbolic GCN to fuse the retinal events densely aggregated and hierarchically modeled in local Euclidean and global hyperbolic spaces, respectively, to achieve a hybrid event perception. Extensive experimental results on event perception tasks, such as object detection and recognition, show the effectiveness of our approach. Our code will be released for public use at https://github.com/ev-lluo/EHGCN.

事件相机图神经网络双曲空间运动感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。