arXiv:2505.10641cs.LG2025-05ICCV被引 2

提出去除测试时特征冗余的新方法,提升模型在分布偏移下的适应能力。

FRET: Feature Redundancy Elimination for Test Time Adaptation

  • 通过最小化特征冗余得分优化模型,提升测试时自适应能力。
  • 引入图卷积与对比学习,显著减少冗余并增强特征区分性。
  • 适合隐私敏感场景,对标签偏移鲁棒,适用于多任务多数据集。

测试时自适应(TTA)旨在应对测试数据与训练数据存在分布偏移时模型的泛化能力问题。在此场景下,仅有预训练模型和未标注测试数据可用,特别适用于隐私敏感应用。实践中发现,随着领域偏移加剧,嵌入特征中的冗余性会增加。然而,现有TTA方法常忽略此冗余问题,影响模型对新数据的适应能力。为此,本文提出特征冗余消除测试时自适应(FRET),包括直接最小化冗余得分的S-FRET,以及结合图卷积网络(GCN)与对比学习的G-FRET。G-FRET不仅降低特征冗余,还在表示层与预测层增强特征判别性。在多种模型架构、任务与数据集上的大量实验表明,S-FRET有效,而G-FRET达到当前最优性能。进一步分析显示,G-FRET能在推理时提取非冗余且高度判别的特征,实现更鲁棒的测试时自适应。

原文摘要 · Abstract (English)

Test-Time Adaptation (TTA) aims to enhance the generalization of deep learning models when faced with test data that exhibits distribution shifts from the training data. In this context, only a pre-trained model and unlabeled test data are available, making it particularly relevant for privacy-sensitive applications. In practice, we observe that feature redundancy in embeddings tends to increase as domain shifts intensify in TTA. However, existing TTA methods often overlook this redundancy, which can hinder the model's adaptability to new data. To address this issue, we introduce Feature Redundancy Elimination for Test-time Adaptation (FRET), a novel perspective for TTA. A straightforward approach (S-FRET) is to directly minimize the feature redundancy score as an optimization objective to improve adaptation. Despite its simplicity and effectiveness, S-FRET struggles with label shifts, limiting its robustness in real-world scenarios. To mitigate this limitation, we further propose Graph-based FRET (G-FRET), which integrates a Graph Convolutional Network (GCN) with contrastive learning. This design not only reduces feature redundancy but also enhances feature discriminability in both the representation and prediction layers. Extensive experiments across multiple model architectures, tasks, and datasets demonstrate the effectiveness of S-FRET and show that G-FRET achieves state-of-the-art performance. Further analysis reveals that G-FRET enables the model to extract non-redundant and highly discriminative features during inference, thereby facilitating more robust test-time adaptation.

测试时自适应特征冗余图神经网络泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。