解决多视图数据维度不平衡问题,让低维信息不被忽略。
AdaMuS: Adaptive Multi-view Sparsity Learning for Dimensionally Unbalanced Data
- 为不同视图设计专用编码器,并自适应剪枝防止过拟合。
- 通过稀疏融合机制有效对齐极端不平衡的视图表示。
- 适合处理视频与生理信号等维度差异大的跨模态任务。
多视图学习旨在融合多个特征以全面描述数据。然而,现有方法通常隐含假设各视图维度相近,而实际中存在严重维度差异,导致不平衡多视图学习问题。例如,在情感识别中,视频帧可达10⁶维,而生理信号仅10¹维。现有方法面临两大挑战:(1) 倾向于高维数据,忽略低维视图;(2) 在极端维度失衡下难以对齐表示,使低维视图引入严重冗余。为此,我们提出自适应多视图稀疏学习(AdaMuS)框架。首先,构建视图专用编码器将低维数据映射至统一空间;为避免低维数据映射至高维时过拟合,设计无参数剪枝方法自适应移除冗余参数。进一步提出稀疏融合机制,灵活抑制冗余维度并有效对齐各视图。此外,为提升泛化能力,引入自监督学习范式,通过构建相似性图获取监督信号。在合成玩具数据集及七个真实世界基准上的大量实验表明,AdaMuS始终表现更优,在分类与语义分割任务中均展现出强泛化能力。
原文摘要 · Abstract (English)
Multi-view learning primarily aims to fuse multiple features to describe data comprehensively. Most prior studies implicitly assume that different views share similar dimensions. In practice, however, severe dimensional disparities often exist among different views, leading to the unbalanced multi-view learning issue. For example, in emotion recognition tasks, video frames often reach dimensions of $10^6$, while physiological signals comprise only $10^1$ dimensions. Existing methods typically face two main challenges for this problem: (1) They often bias towards high-dimensional data, overlooking the low-dimensional views. (2) They struggle to effectively align representations under extreme dimensional imbalance, which introduces severe redundancy into the low-dimensional ones. To address these issues, we propose the Adaptive Multi-view Sparsity Learning (AdaMuS) framework. First, to prevent ignoring the information of low-dimensional views, we construct view-specific encoders to map them into a unified dimensional space. Given that mapping low-dimensional data to a high-dimensional space often causes severe overfitting, we design a parameter-free pruning method to adaptively remove redundant parameters in the encoders. Furthermore, we propose a sparse fusion paradigm that flexibly suppresses redundant dimensions and effectively aligns each view. Additionally, to learn representations with stronger generalization, we propose a self-supervised learning paradigm that obtains supervision information by constructing similarity graphs. Extensive evaluations on a synthetic toy dataset and seven real-world benchmarks demonstrate that AdaMuS consistently achieves superior performance and exhibits strong generalization across both classification and semantic segmentation tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。