解决多视图数据无对齐问题,实现概率对齐聚类
Probabilistically Aligned View-unaligned Clustering with Adaptive Template Selection
- 用双图结构学习一致锚点与视图特有图
- 通过马尔可夫链重构实现视图间概率对齐
- 适配模板选择提升对齐精度,适合无对齐数据场景
在多数现有多视图建模中,同一目标在不同视图间的实例对应关系(如图像-文本配对)是获得一致表征的关键前提。然而,在某些应用中,各视图独立组织与传输,导致视图无对齐问题(VuP)。恢复无对齐多视图数据的跨视图对应关系是一项极具挑战性且研究较少的任务。为此,本文提出将排列推导过程融入二分图范式,构建概率对齐的无对齐聚类方法(PAVuC-ATS)。具体而言,通过二分图学习一致锚点与视图特定图,并将两组潜在表示间的对齐重构成具有自适应模板选择的马尔可夫链两步转移过程,从而实现概率对齐。所提优化问题的收敛性在实验与理论上均得到验证。在六个基准数据集上的大量实验表明,PAVuC-ATS 显著优于基线方法。
原文摘要 · Abstract (English)
In most existing multi-view modeling scenarios, cross-view correspondence (CVC) between instances of the same target from different views, like paired image-text data, is a crucial prerequisite for effortlessly deriving a consistent representation. Nevertheless, this premise is frequently compromised in certain applications, where each view is organized and transmitted independently, resulting in the view-unaligned problem (VuP). Restoring CVC of unaligned multi-view data is a challenging and highly demanding task that has received limited attention from the research community. To tackle this practical challenge, we propose to integrate the permutation derivation procedure into the bipartite graph paradigm for view-unaligned clustering, termed Probabilistically Aligned View-unaligned Clustering with Adaptive Template Selection (PAVuC-ATS). Specifically, we learn consistent anchors and view-specific graphs by the bipartite graph, and derive permutations applied to the unaligned graphs by reformulating the alignment between two latent representations as a 2-step transition of a Markov chain with adaptive template selection, thereby achieving the probabilistic alignment. The convergence of the resultant optimization problem is validated both experimentally and theoretically. Extensive experiments on six benchmark datasets demonstrate the superiority of the proposed PAVuC-ATS over the baseline methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。