通过分层共识机制提升多视图特征一致性,显著增强分类性能。
Hierarchical Consensus Network for Multiview Feature Learning
- 设计三层共识机制:类别、编码与全局共识,层层强化视图间一致性
- 在4个数据集上超越现有方法,最高提升6.2%准确率
- 适合多视角学习、特征融合及需要高鲁棒性的场景
多视图特征学习旨在通过整合各视图的差异信息来学习具有判别性的特征。然而,现有方法在学习视图一致特征方面仍面临挑战,而此类特征对有效多视图学习至关重要。受典型相关分析(CCA)和对比学习理论启发,本文提出分层共识网络(HCN)。HCN引入三种共识指标以捕捉跨视图的层次化共识:分类共识、编码共识与全局共识。其中,分类共识从CCA角度强化视图间的类别级对应关系;编码共识类比对比学习,反映个体样本间的对比关系;全局共识则同时从两个视角提取共识信息。通过强制实现分层共识,各视图内部信息得以更好融合,从而获得更全面且更具判别力的特征。在四个多视图数据集上的大量实验结果表明,所提方法显著优于多个先进方法。
原文摘要 · Abstract (English)
Multiview feature learning aims to learn discriminative features by integrating the distinct information in each view. However, most existing methods still face significant challenges in learning view-consistency features, which are crucial for effective multiview learning. Motivated by the theories of CCA and contrastive learning in multiview feature learning, we propose the hierarchical consensus network (HCN) in this paper. The HCN derives three consensus indices for capturing the hierarchical consensus across views, which are classifying consensus, coding consensus, and global consensus, respectively. Specifically, classifying consensus reinforces class-level correspondence between views from a CCA perspective, while coding consensus closely resembles contrastive learning and reflects contrastive comparison of individual instances. Global consensus aims to extract consensus information from two perspectives simultaneously. By enforcing the hierarchical consensus, the information within each view is better integrated to obtain more comprehensive and discriminative features. The extensive experimental results obtained on four multiview datasets demonstrate that the proposed method significantly outperforms several state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。