arXiv:2605.25110cs.CVcs.AI2026-05

提出带不确定性的动态时间规整,让模型自动识别并忽略噪声数据。

Uncertainty-DTW for Sequences and Visual Tokens

论文配图:Uncertainty-DTW for Sequences and Visual Tokens
图 1 · 摘自论文原文
  • 用概率分布建模匹配可靠性,根据置信度加权对齐。
  • 在动作识别和视觉特征对齐任务中显著提升精度。
  • 适合需要可解释性对齐的视觉与时序分析场景。

对齐结构化数据是计算机视觉与机器学习中的基础问题,涉及时间序列分析、人体动作识别和视觉表征学习等任务。现有对齐方法(如DTW及其可微变体)依赖确定性相似度度量,对异质和噪声特征敏感。本文提出不确定性感知对齐框架——不确定性DTW(uDTW),通过为每对对应关系建模异方差不确定性,并沿对齐路径进行结构化匹配。uDTW为每个对应关系分配正态分布,将对齐路径参数化为最大似然估计目标,包含两项:(i) 精度加权匹配项,抑制不可靠特征;(ii) 对数方差正则项,防止退化解。该机制具备抗噪能力且可解释,不确定性直接反映匹配可靠性。进一步将框架从时序序列推广至视觉标记化表示,实现视觉标记集的结构化对齐。学习到的不确定性可解释为反向注意力:语义相关区域不确定性低,主导对齐;模糊/噪声区域不确定性高。这建立了对齐、注意力与不确定性建模之间的联系。在多个领域评估表明,该方法持续优于当前最优模型,且学习到的不确定性与语义重要性高度相关。结果确立了不确定性感知对齐作为学习结构化数据的通用、鲁棒且可解释的框架。

原文摘要 · Abstract (English)

Aligning structured data is a fundamental problem in computer vision and machine learning, underlying tasks such as time series analysis, human action recognition, and visual representation learning. Existing alignment methods, including Dynamic Time Warping (DTW) and its differentiable variants, rely on deterministic similarity measures and are therefore sensitive to heterogeneous and noisy features. In this work, we introduce uncertainty-aware alignment, a probabilistic framework that models pairwise correspondences with heteroscedastic uncertainty and performs structured matching along alignment paths. Our formulation, uncertainty-DTW (uDTW), assigns each correspondence a Normal distribution and parametrizes each alignment path by a Maximum Likelihood Estimate objective consisting of (i) a precision-weighted matching term that suppresses unreliable features, and (ii) a log-variance regularization that prevents degenerate solutions. This yields a probabilistic alignment mechanism that is robust to noise and interpretable, as uncertainty directly reflects the reliability of matches. We further generalize this framework from temporal sequences to tokenized visual representations, enabling structured matching over sets of visual tokens. The learned uncertainty can be interpreted as a reverse-attention: semantically relevant regions exhibit low uncertainty and dominate the alignment, while ambiguous/noisy regions have high uncertainty. This provides a connection between alignment, attention, and uncertainty modeling. We evaluate the proposed framework across diverse domains. The results demonstrate consistent improvements over state-of-the-art methods and show that learned uncertainty correlates with semantic importance. These findings establish uncertainty-aware alignment as a general, robust, and interpretable framework for learning from structured data.

对齐不确定性视觉表征动态时间规整

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。