解决多视图学习中视图冲突问题,提升模型鲁棒性与可信度。
Robust Fuzzy Multi-view Learning under View Conflict

- 用模糊集理论建模视图输出,量化类别可信度。
- 在8个数据集上优于15个主流方法,提升鲁棒性与不确定性估计。
- 适合处理真实场景中存在视图冲突的多视图分类任务。
可信多视图分类旨在实现可靠融合以获得准确预测,近年来受到学术界和工业界的广泛关注。然而,现有方法通常假设训练和测试阶段各视图严格对齐,这在真实场景中往往不现实。这一局限促使我们重新审视可信多视图分类,并将其扩展到更具挑战性的设置:如何在训练和推理过程中缓解视图冲突(VC)的影响。现有方法面临三个关键缺陷:不确定性低估、误导性决策以及对视图冲突的过拟合。为此,本文提出一种基于模糊集理论的鲁棒模糊多视图学习(R-FUML)框架。具体而言,R-FUML将网络输出建模为模糊隶属度,以量化类别可信度,并采用基于熵的方法实现可靠的多视图融合。为此,我们设计了一种鲁棒多视图融合(RMF)策略,同时考虑视图特异性不确定性和视图间冲突,从而减轻视图冲突对决策的负面影响。为在训练中识别并克服视图冲突,我们进一步提出了鲁棒对抗视图冲突学习(RLVC)框架。该框架利用神经网络的记忆效应隔离冲突样本,并通过惩罚机制对这些冲突视图进行重训练。在八个公开数据集上的大量实验表明,R-FUML在鲁棒性和不确定性估计方面持续优于15个最先进的基线方法。代码将在接受后发布。
原文摘要 · Abstract (English)
Trusted multi-view classification aims to deliver reliable fusion for accurate predictions and has recently attracted substantial attention in both academia and industry. However, existing TMVC methods typically assume strict alignment across different views during both training and testing phases, which is often impractical in real-world scenarios. This limitation motivates us to revisit TMVC and extend it to a more challenging setting: how to mitigate the impact of view conflict (VC) during both training and inference. To tackle this setting, existing TMVC methods suffer from three critical limitations: underestimated uncertainty, misleading decisions, and overfitting to VC. To address these issues, this paper proposes a novel Robust Fuzzy Multi-View Learning (R-FUML) framework grounded in Fuzzy Set Theory. Specifically, R-FUML models network outputs as fuzzy memberships to quantify category credibility and uses an entropy-based method for reliable multi-view fusion. To this end, we present a Robust Multi-view Fusion (RMF) strategy that accounts for both view-specific uncertainty and inter-view conflicts, thereby alleviating the adverse impacts of VC on decision-making. To identify and conquer VC during training, we further design a Robust Learning Against VC (RLVC) framework. RLVC isolates conflicting samples by leveraging neural networks' memory effects and then retrains the model by applying a penalty to these conflicting views. Extensive experiments across eight public datasets demonstrate that R-FUML consistently outperforms 15 state-of-the-art baselines in robustness and uncertainty estimation. The code will be released upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。