针对测试时分布变化,提出基于特征邻域发现的自适应方法
Feature-Based Instance Neighbor Discovery: Advanced Stable Test-Time Adaptation in Dynamic World
- 通过构建图结构识别层内相似特征分布,实现稳定特征解耦
- 在动态场景下比现有方法提升30%准确率,且计算开销低
- 适合需要实时适应多变测试环境的部署场景
尽管深度神经网络已有进展,但在训练与测试域分布偏移下仍会出现性能下降,严重影响应用的体验质量。现有测试时自适应(TTA)方法难以应对批次中存在多个动态测试分布的情况。我们观察到不同域的特征分布天然形成具有不同均值和方差的簇。这一差异揭示了传统全局归一化策略在TTA中的根本缺陷,即会扭曲原始数据特性。基于此,我们提出特征基础实例邻域发现(FIND),包含三个核心组件:层间特征解耦(LFD)、特征感知批归一化(FABN)和选择性FABN(S-FABN)。LFD通过构建图结构,在每层稳定捕捉分布相似的特征。FABN将源域统计与测试时特定分布统计最优结合,实现鲁棒特征表示。S-FABN确定哪些层需特征分割、哪些可保持统一,从而提升推理效率。大量实验表明,FIND显著优于现有方法,在动态场景下实现30%的准确率提升,同时保持计算高效。
原文摘要 · Abstract (English)
Despite progress, deep neural networks still suffer performance declines under distribution shifts between training and test domains, leading to a substantial decrease in Quality of Experience (QoE) for applications. Existing test-time adaptation (TTA) methods are challenged by dynamic, multiple test distributions within batches. We observe that feature distributions across different domains inherently cluster into distinct groups with varying means and variances. This divergence reveals a critical limitation of previous global normalization strategies in TTA, which inevitably distort the original data characteristics. Based on this insight, we propose Feature-based Instance Neighbor Discovery (FIND), which comprises three key components: Layer-wise Feature Disentanglement (LFD), Feature Aware Batch Normalization (FABN) and Selective FABN (S-FABN). LFD stably captures features with similar distributions at each layer by constructing graph structures. While FABN optimally combines source statistics with test-time distribution specific statistics for robust feature representation. Finally, S-FABN determines which layers require feature partitioning and which can remain unified, thereby enhancing inference efficiency. Extensive experiments demonstrate that FIND significantly outperforms existing methods, achieving a 30\% accuracy improvement in dynamic scenarios while maintaining computational efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。