arXiv:2409.00755cs.CVcs.AI2024-09AAAI被引 40

TUNED通过融合局部与全局邻域结构,提升多视图分类在高不确定性下的鲁棒性。

Trusted Unified Feature-Neighborhood Dynamics for Multi-View Classification

  • 引入局部与全局特征邻域结构,构建统一动态模型
  • 在多个基准数据集上准确率优于现有方法,尤其在冲突视图下表现更优
  • 适合处理存在视图差异和不确定性的多源数据分类任务

多视图分类(MVC)因不同视图间的领域差距与不一致性,常导致融合过程中的不确定性。尽管证据深度学习(EDL)在处理视图不确定性方面有效,但现有方法多依赖对冲突证据敏感的Dempster-Shafer组合规则,且忽视了多视图数据中邻域结构的关键作用。为此,我们提出可信统一特征-邻域动态模型(TUNED),用于增强多视图分类的鲁棒性。该方法有效整合各视图内的局部特征-邻域(F-N)结构,并引入可选马尔可夫随机场,自适应管理跨视图邻域依赖关系,以缓解潜在的不确定性与冲突。同时,采用共享参数化证据提取器,基于局部F-N结构学习全局共识,从而强化多视图特征的全局融合。在多个基准数据集上的实验表明,该方法在高不确定性与冲突视图场景下,显著提升准确率与鲁棒性。代码将公开于https://github.com/JethroJames/TUNED。

原文摘要 · Abstract (English)

Multi-view classification (MVC) faces inherent challenges due to domain gaps and inconsistencies across different views, often resulting in uncertainties during the fusion process. While Evidential Deep Learning (EDL) has been effective in addressing view uncertainty, existing methods predominantly rely on the Dempster-Shafer combination rule, which is sensitive to conflicting evidence and often neglects the critical role of neighborhood structures within multi-view data. To address these limitations, we propose a Trusted Unified Feature-NEighborhood Dynamics (TUNED) model for robust MVC. This method effectively integrates local and global feature-neighborhood (F-N) structures for robust decision-making. Specifically, we begin by extracting local F-N structures within each view. To further mitigate potential uncertainties and conflicts in multi-view fusion, we employ a selective Markov random field that adaptively manages cross-view neighborhood dependencies. Additionally, we employ a shared parameterized evidence extractor that learns global consensus conditioned on local F-N structures, thereby enhancing the global integration of multi-view features. Experiments on benchmark datasets show that our method improves accuracy and robustness over existing approaches, particularly in scenarios with high uncertainty and conflicting views. The code will be made available at https://github.com/JethroJames/TUNED.

多视图分类证据学习邻域结构鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。