提出一种统一压缩与域适应的新方法,提升设备端模型泛化能力。
Frequency Composition for Compressed and Domain-Adaptive Neural Networks
- 用低频成分训练压缩模型,学习通用特征
- 测试时利用高频成分自适应目标域,准确率提升超5%
- 无需源数据,可无缝集成现有压缩与自适应技术
现代设备端神经网络需在资源受限下应对未知域变化,但压缩与域适应长期被分开处理:压缩模型强调效率,大模型则专注抗域偏移。本文提出CoDA框架,通过频率分解统一二者。训练时采用量化感知训练(QAT)结合低频成分,使压缩模型学习鲁棒通用特征;测试时以无源方式(即测试时自适应,TTA)利用输入数据的全频信息,将高频成分作为域特定信号,仅用于批量归一化。低频成分对齐训练分布,高频成分仅服务目标域适配。CoDA可与现有QAT和TTA方法协同。在CIFAR10-C和ImageNet-C等常见域偏移基准上验证,显著压缩下,相比全精度TTA基线,分别实现7.96个百分点和5.37个百分点的准确率提升。
原文摘要 · Abstract (English)
Modern on-device neural network applications must operate under resource constraints while adapting to unpredictable domain shifts. However, this combined challenge-model compression and domain adaptation-remains largely unaddressed, as prior work has tackled each issue in isolation: compressed networks prioritize efficiency within a fixed domain, whereas large, capable models focus on handling domain shifts. In this work, we propose CoDA, a frequency composition-based framework that unifies compression and domain adaptation. During training, CoDA employs quantization-aware training (QAT) with low-frequency components, enabling a compressed model to selectively learn robust, generalizable features. At test time, it refines the compact model in a source-free manner (i.e., test-time adaptation, TTA), leveraging the full-frequency information from incoming data to adapt to target domains while treating high-frequency components as domain-specific cues. LFC are aligned with the trained distribution, while HFC unique to the target distribution are solely utilized for batch normalization. CoDA can be integrated synergistically into existing QAT and TTA methods. CoDA is evaluated on widely used domain-shift benchmarks, including CIFAR10-C and ImageNet-C, across various model architectures. With significant compression, it achieves accuracy improvements of 7.96%p on CIFAR10-C and 5.37%p on ImageNet-C over the full-precision TTA baseline.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。