arXiv:2508.01842cs.CV2025-08AAAI

统一事件数据表征,无需为每任务重设计网络

OmniEvent: Unified Event Representation Learning

  • 分离处理时空特征,避免数据分布不均问题
  • 跨10个数据集3类任务,性能提升最高达68.2%
  • 输出网格张量,适配标准视觉模型,即插即用

事件相机因其超高的动态范围和时间分辨率在计算机视觉中日益流行。然而,事件网络因数据分布无结构且时空分布不均,严重依赖任务特定设计,难以复用现有架构。本文提出OmniEvent,首个统一事件表征学习框架,在多种任务上实现最优表现,完全消除任务定制需求。不同于以往将事件数据视为带手动调参时空权重的3D点云的方法,OmniEvent采用解耦-增强-融合范式:在空间与时间域独立进行局部特征聚合与增强,避免不均问题;采用空间填充曲线实现大感受野,同时提升内存与计算效率;最后通过注意力机制融合域间特征,学习时空交互。输出为网格张量,可直接由标准视觉模型处理而无需修改架构。在3个代表性任务和10个数据集上,采用统一框架与相似超参数,性能相比(任务专用)现有最优方法最高提升68.2%。代码将于https://github.com/Wickyan/OmniEvent发布。

原文摘要 · Abstract (English)

Event cameras have gained increasing popularity in computer vision due to their ultra-high dynamic range and temporal resolution. However, event networks heavily rely on task-specific designs due to the unstructured data distribution and spatial-temporal (S-T) inhomogeneity, making it hard to reuse existing architectures for new tasks. We propose OmniEvent, the first unified event representation learning framework that achieves SOTA performance across diverse tasks, fully removing the need of task-specific designs. Unlike previous methods that treat event data as 3D point clouds with manually tuned S-T scaling weights, OmniEvent proposes a decouple-enhance-fuse paradigm, where the local feature aggregation and enhancement is done independently on the spatial and temporal domains to avoid inhomogeneity issues. Space-filling curves are applied to enable large receptive fields while improving memory and compute efficiency. The features from individual domains are then fused by attention to learn S-T interactions. The output of OmniEvent is a grid-shaped tensor, which enables standard vision models to process event data without architecture change. With a unified framework and similar hyper-parameters, OmniEvent out-performs (tasks-specific) SOTA by up to 68.2% across 3 representative tasks and 10 datasets (Fig.1). Code will be ready in https://github.com/Wickyan/OmniEvent .

事件相机统一表征时空建模视觉模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。