用事件相机建模不均匀运动轨迹,提升3D运动估计精度
EMoTive: Event-guided Trajectory Modeling for 3D Motion Estimation
- 通过事件引导的非均匀参数曲线建模复杂运动
- 在合成与真实数据集上实现更优的光流和深度运动场
- 适合需要高动态场景下精准运动估计的研究者
视觉3D运动估计旨在基于视觉线索推断2D像素在3D空间中的运动。以往方法因深度变化导致的时空运动不一致,破坏了局部空间或时间平滑性假设。事件相机通过连续自适应的像素级响应为3D运动估计提供新可能。本文提出EMoTive,一种基于事件的框架,通过事件引导的非均匀参数化曲线建模时空轨迹,有效表征局部异质的时空运动。首先引入事件谱图(Event Kymograph),采用连续时间投影核并解耦空间观测,显式编码精细的时间演化。在运动表示上,设计密度感知自适应机制,在事件引导下融合时空特征,并结合非均匀有理曲线参数化框架,自适应建模异质轨迹。最终通过多时间采样参数化轨迹,获得光流与深度运动场。为评估性能,构建CarlaEvent3D——一个用于全面验证的多动态合成数据集。在该数据集及真实世界基准上的实验表明方法有效。
原文摘要 · Abstract (English)
Visual 3D motion estimation aims to infer the motion of 2D pixels in 3D space based on visual cues. The key challenge arises from depth variation induced spatio-temporal motion inconsistencies, disrupting the assumptions of local spatial or temporal motion smoothness in previous motion estimation frameworks. In contrast, event cameras offer new possibilities for 3D motion estimation through continuous adaptive pixel-level responses to scene changes. This paper presents EMoTive, a novel event-based framework that models spatio-temporal trajectories via event-guided non-uniform parametric curves, effectively characterizing locally heterogeneous spatio-temporal motion. Specifically, we first introduce Event Kymograph - an event projection method that leverages a continuous temporal projection kernel and decouples spatial observations to encode fine-grained temporal evolution explicitly. For motion representation, we introduce a density-aware adaptation mechanism to fuse spatial and temporal features under event guidance, coupled with a non-uniform rational curve parameterization framework to adaptively model heterogeneous trajectories. The final 3D motion estimation is achieved through multi-temporal sampling of parametric trajectories, yielding optical flow and depth motion fields. To facilitate evaluation, we introduce CarlaEvent3D, a multi-dynamic synthetic dataset for comprehensive validation. Extensive experiments on both this dataset and a real-world benchmark demonstrate the effectiveness of the proposed method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。