arXiv:2602.14376cs.CV2026-02

用事件流+图像融合实现高效高动态变形测量

Event-based Visual Deformation Measurement

  • 结合事件数据与图像,分区域线性化建模降低运动模糊
  • 在仅18.9%资源下,生存率比现有方法高1.6%
  • 适合高速动态场景下的实时变形追踪应用

视觉变形测量(VDM)旨在通过相机观测追踪表面运动以恢复稠密变形场。传统基于图像的方法依赖帧间小位移来约束对应关系搜索空间,限制了其在高度动态场景中的应用,或需高帧率相机带来高昂存储与计算开销。本文提出事件-帧融合框架,利用事件提供时序稠密运动线索,图像提供空间稠密精确估计。重访固体力学建模先验,提出仿射不变单纯形(AIS)框架,将变形场划分为低参数化的线性子区域,有效缓解稀疏噪声事件引起的运动歧义。为加速参数搜索并减少误差累积,引入邻域贪心优化策略,使收敛良好的子区域引导收敛较差的邻域,有效抑制长期稠密追踪中的局部误差积累。为评估方法,构建包含超过120个序列的基准数据集,涵盖多样变形场景,具有时间对齐的事件流与图像。实验表明,本方法在生存率上优于最先进基线1.6%,且仅需高帧率视频方法18.9%的数据存储与处理资源。

原文摘要 · Abstract (English)

Visual Deformation Measurement (VDM) aims to recover dense deformation fields by tracking surface motion from camera observations. Traditional image-based methods rely on minimal inter-frame motion to constrain the correspondence search space, which limits their applicability to highly dynamic scenes or necessitates high-speed cameras at the cost of prohibitive storage and computational overhead. We propose an event-frame fusion framework that exploits events for temporally dense motion cues and frames for spatially dense precise estimation. Revisiting the solid elastic modeling prior, we propose an Affine Invariant Simplicial (AIS) framework. It partitions the deformation field into linearized sub-regions with low-parametric representation, effectively mitigating motion ambiguities arising from sparse and noisy events. To speed up parameter searching and reduce error accumulation, a neighborhood-greedy optimization strategy is introduced, enabling well-converged sub-regions to guide their poorly-converged neighbors, effectively suppress local error accumulation in long-term dense tracking. To evaluate the proposed method, a benchmark dataset with temporally aligned event streams and frames is established, encompassing over 120 sequences spanning diverse deformation scenarios. Experimental results show that our method outperforms the state-of-the-art baseline by 1.6% in survival rate. Remarkably, it achieves this using only 18.9% of the data storage and processing resources of high-speed video methods.

变形测量事件相机多模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。