arXiv:2508.16976cs.CVcs.LG2025-08被引 1

通过选择性更新稀疏参数,保留预训练模型的泛化能力。

Preserving Domain Generalization in Fine-Tuning via Joint Parameter Selection

  • 仅更新跨源域梯度一致且显著的稀疏参数
  • 理论证明参数更新稀疏性有助于降低泛化误差
  • 在多个基准上优于现有方法,适合需泛化能力的场景

领域泛化旨在训练出仅基于有限源域、却能有效适应未见目标域的模型。尽管主流方法以大规模预训练视觉模型作为初始化,但近期研究指出全量微调会损害其内在泛化能力。为此,参数高效适配策略应运而生,仅选择性微调部分参数,在任务适应与泛化保持间取得平衡。受此启发,本文提出联合参数选择(JPS),限制仅一小部分稀疏参数更新,从而保留并利用预训练模型的泛化优势。理论上,我们建立了显式考虑参数更新稀疏性的泛化误差界,为选择性微调提供理论依据。实践中,设计双算子机制,识别并更新所有源域中梯度一致且显著的参数。大量基准实验表明,JPS性能优于当前最优领域泛化方法,验证了该方法在效率与有效性上的双重优势。

原文摘要 · Abstract (English)

Domain generalization seeks to develop models trained on a limited set of source domains that are capable of generalizing effectively to unseen target domains. While the predominant approach leverages large-scale pre-trained vision models as initialization, recent studies have highlighted that full fine-tuning can compromise the intrinsic generalization capabilities of these models. To address this limitation, parameter-efficient adaptation strategies have emerged, wherein only a subset of model parameters is selectively fine-tuned, thereby balancing task adaptation with the preservation of generalization. Motivated by this paradigm, we introduce Joint Parameter Selection (JPS), a novel method that restricts updates to a small, sparse subset of parameters, thereby retaining and harnessing the generalization strength of pre-trained models. Theoretically, we establish a generalization error bound that explicitly accounts for the sparsity of parameter updates, thereby providing a principled justification for selective fine-tuning. Practically, we design a selection mechanism employing dual operators to identify and update parameters exhibiting consistent and significant gradients across all source domains. Extensive benchmark experiments demonstrate that JPS achieves superior performance compared to state-of-the-art domain generalization methods, substantiating both the efficiency and efficacy of the proposed approach.

领域泛化参数高效微调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。