提出SpecRaGE框架,解决多视图学习中噪声干扰与泛化难题。
Generalizable and Robust Spectral Method for Multi-view Representation Learning
- 用神经网络近似图拉普拉斯矩阵联合对角化,避免传统对齐操作。
- 在含噪声数据上性能超越现有方法,下游任务准确率提升显著。
- 适合处理带异常值的多源数据,尤其适用于实际场景中的鲁棒建模。
多视图表示学习近年来受到广泛关注,尤其在需整合多源数据的应用中。基于图拉普拉斯的方法虽表现优异,但普遍存在泛化能力差、可扩展性不足的问题,且对噪声和离群点敏感。当前深度学习方法依赖对齐或对比目标,在数据被污染时反而会强化错误一致性,导致下游性能下降。本文提出SpecRaGE,一种融合图拉普拉斯优势与深度学习能力的新框架。该方法通过神经网络学习参数化映射,逼近多个图拉普拉斯矩阵的联合对角化,无需显式对齐即可实现可泛化、可扩展的表示学习。同时引入元学习融合模块,动态适应不同数据质量,增强对抗噪声和异常视图的鲁棒性。大量实验表明,SpecRaGE在含数据污染的场景下显著优于当前最优方法,为更可靠高效的多视图学习提供了新路径。
原文摘要 · Abstract (English)
Multi-view representation learning (MvRL) has garnered substantial attention in recent years, driven by the increasing demand for applications that can effectively process and analyze data from multiple sources. In this context, graph Laplacian-based MvRL methods have demonstrated remarkable success in representing multi-view data. However, these methods often struggle with generalization to new data and face challenges with scalability. Moreover, in many practical scenarios, multi-view data is contaminated by noise or outliers. In such cases, modern deep-learning-based MvRL approaches that rely on alignment or contrastive objectives present degraded performance in downstream tasks, as they may impose incorrect consistency between clear and corrupted data sources. We introduce $\textit{SpecRaGE}$, a novel fusion-based framework that integrates the strengths of graph Laplacian methods with the power of deep learning to overcome these challenges. SpecRage uses neural networks to learn parametric mapping that approximates a joint diagonalization of graph Laplacians. This solution bypasses the need for alignment while enabling generalizable and scalable learning of informative and meaningful representations. Moreover, it incorporates a meta-learning fusion module that dynamically adapts to data quality, ensuring robustness against outliers and noisy views. Our extensive experiments demonstrate that SpecRaGE outperforms state-of-the-art methods, particularly in scenarios with data contamination, paving the way for more reliable and efficient multi-view learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。