arXiv:2410.22978stat.MLcs.LG2024-10ICML被引 6

提出两种新方法,用图结构对齐多源数据的潜在空间。

Graph Integration for Diffusion-Based Manifold Alignment

  • 构建统一图结构,通过已知对应关系连接不同数据域
  • 在真实对应关系对齐和跨域分类上优于现有方法
  • 适合需要跨模态数据融合与标签迁移的场景

来自不同来源或模态的个体观测数据往往内在关联。多模态数据整合可比单源数据提供更丰富的信息。流形对齐是一种数据整合方式,旨在为多个数据源寻找共享的低维潜在表示,突出同一实体在不同表达中的相似性。半监督流形对齐依赖部分已知的域间对应关系,可通过共享特征或其他已知关联实现。本文提出两种半监督流形对齐方法:第一种是基于域联合图的最短路径(SPUD),利用已知对应关系构建统一图结构,学习域间测地距离,形成全局多域结构;第二种是基于随机游走的流形对齐(MASH),在各域内学习局部几何,结合已知对应关系构造联合扩散算子,通过迭代随机游走过程学习新的域间对应关系,形成耦合矩阵将异构域整合为统一结构。实验表明,SPUD和MASH在对齐真实对应关系和跨域分类任务中均优于现有方法。此外,还展示了如何利用这些方法在域间迁移标签信息。

原文摘要 · Abstract (English)

Data from individual observations can originate from various sources or modalities but are often intrinsically linked. Multimodal data integration can enrich information content compared to single-source data. Manifold alignment is a form of data integration that seeks a shared, underlying low-dimensional representation of multiple data sources that emphasizes similarities between alternative representations of the same entities. Semi-supervised manifold alignment relies on partially known correspondences between domains, either through shared features or through other known associations. In this paper, we introduce two semi-supervised manifold alignment methods. The first method, Shortest Paths on the Union of Domains (SPUD), forms a unified graph structure using known correspondences to establish graph edges. By learning inter-domain geodesic distances, SPUD creates a global, multi-domain structure. The second method, MASH (Manifold Alignment via Stochastic Hopping), learns local geometry within each domain and forms a joint diffusion operator using known correspondences to iteratively learn new inter-domain correspondences through a random-walk approach. Through the diffusion process, MASH forms a coupling matrix that links heterogeneous domains into a unified structure. We compare SPUD and MASH with existing semi-supervised manifold alignment methods and show that they outperform competing methods in aligning true correspondences and cross-domain classification. In addition, we show how these methods can be applied to transfer label information between domains.

流形对齐多模态融合图神经网络半监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。