提出新模型提升多模态数据在噪声下的分类可靠性。
Test-time Adaptive Hierarchical Co-enhanced Denoising Network for Reliable Multimodal Classification
- 分层自适应去噪,同时处理全局与样本级异构噪声。
- 测试时无标签协同增强,显著提升对未知噪声的泛化能力。
- 适合医疗诊断等高安全要求的多模态分析场景。
多模态数据(如多组学)的可靠学习在医疗诊断等安全关键应用中备受关注。然而,多模态噪声导致的数据质量低下成为主要挑战,现有方法存在两大局限:难以处理异构噪声,影响鲁棒性;对未见过的噪声适应性差。为此,本文提出测试时自适应分层协同增强去噪网络(TAHCD)。一方面,通过自适应稳定子空间对齐和样本自适应置信度对齐,在全局与实例层面联合去除模态特异性与跨模态噪声,实现稳健学习。另一方面,引入测试时协同增强机制,无需标签即可根据输入噪声动态更新模型,提升泛化性能。该机制通过协同优化各层级的噪声去除过程,增强对噪声的适应性。在多个基准数据集上的实验表明,所提方法在分类性能、鲁棒性与泛化能力上均优于当前最先进的可靠多模态学习方法。
原文摘要 · Abstract (English)
Reliable learning of multimodal data (e.g., multi-omics) is a widely concerning issue, especially in safety-critical applications such as medical diagnosis. However, low-quality data induced by multimodal noise poses a major challenge in this domain, causing existing methods to suffer from two key limitations. First, they struggle to handle heterogeneous data noise, hindering robust multimodal representation learning. Second, they exhibit limited adaptability and generalization when encountering previously unseen noise. To address these issues, we propose Test-time Adaptive Hierarchical Co-enhanced Denoising Network (TAHCD). On one hand, TAHCD introduces the Adaptive Stable Subspace Alignment and Sample-Adaptive Confidence Alignment to reliably remove heterogeneous noise. They account for noise at both global and instance levels and enable jointly removal of modality-specific and cross-modality noise, achieving robust learning. On the other hand, TAHCD introduces Test-Time Cooperative Enhancement, which adaptively updates the model in response to input noise in a label-free manner, thus improving generalization. This is achieved by collaboratively enhancing the joint removal process of modality-specific and cross-modality noise across global and instance levels according to sample noise. Experiments on multiple benchmarks demonstrate that the proposed method achieves superior classification performance, robustness, and generalization compared with state-of-the-art reliable multimodal learning approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。