通过交织扩散轨迹构建多视图数据几何结构,提升聚类与流形学习效果。
Multi-view diffusion geometry using intertwined diffusion trajectories
- 设计交织的多视图扩散轨迹,动态融合不同数据视角信息。
- 理论证明过程与算子的遍历性,推导出基于奇异值分解的嵌入表示。
- 提供可学习的算子空间和评估基准,适用于流形学习与聚类任务。
本文提出一种统一框架,通过交织的多视图扩散轨迹(MDTs)构建多视图扩散几何结构。MDTs 是一类非齐次扩散过程,通过迭代结合多个数据视图的随机游走算子,定义依赖于轨迹的扩散算子,具有明确的概率与几何解释,能随时间捕捉视图间的交互关系。该框架涵盖现有模型,并为视图交互与融合引入新自由度。在弱假设下建立了算子与过程本身的遍历性等理论性质,推导了基于 MDT 的扩散距离及奇异值分解得到的嵌入表示。此外,提出了在算子空间中学习 MDT 算子的多种策略,以内部质量度量为指导。除支持灵活建模外,MDTs 还可作为评估扩散方法的中性基线,通过与随机选择的 MDT 对比实现。实验表明,在流形学习与数据聚类任务中,MDT 算子具有显著实际效果。
原文摘要 · Abstract (English)
This paper introduces a comprehensive unified framework for constructing multi-view diffusion geometries through intertwined multi-view diffusion trajectories (MDTs), a class of inhomogeneous diffusion processes that iteratively combine the random walk operators of multiple data views. Each MDT defines a trajectory-dependent diffusion operator with a clear probabilistic and geometric interpretation, capturing over time the interplay between data views. Our formulation encompasses existing multi-view diffusion models, while providing new degrees of freedom for view interaction and fusion. We establish theoretical properties under mild assumptions, including ergodicity of both the point-wise operator and the process in itself. We also derive MDT-based diffusion distances, and associated embeddings via singular value decompositions. Finally, we propose various strategies for learning MDT operators within the defined operator space, guided by internal quality measures. Beyond enabling flexible model design, MDTs also offer a neutral baseline for evaluating diffusion-based approaches through comparison with randomly selected MDTs. Experiments show the practical impact of the MDT operators in a manifold learning and data clustering context.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。