arXiv:2512.02369cs.CV2025-12

不修改模型权重,用风格提示提升分割模型跨域泛化能力

SAGE: Style-Adaptive Generalization for Privacy-Constrained Semantic Segmentation Across Domains

  • 通过风格迁移生成多样化视觉提示,动态融合以适应输入场景
  • 在五个数据集上表现优于现有隐私约束方法,接近全微调效果
  • 适合无法访问模型参数的隐私敏感场景,如医疗图像分割

语义分割的领域泛化旨在缓解因领域偏移导致的性能下降。然而,在许多实际场景中,由于隐私和安全限制,无法获取模型参数和架构细节,传统微调或适配方法受阻,亟需无需修改模型权重的输入级策略。为此,我们提出一种风格自适应泛化框架(SAGE),在隐私约束下提升冻结模型的泛化能力。SAGE通过风格迁移构建源域多样化的风格表示,学习能覆盖广泛视觉特征的风格特性;再根据每张输入的视觉上下文,自适应融合这些风格线索,形成动态提示,和谐统一图像外观而不改动模型内部结构。这种闭环设计有效弥合了冻结模型不变性与未见领域多样性之间的差距。在五个基准数据集上的大量实验表明,SAGE在隐私约束下达到或超过当前最优方法的表现,且在所有设置中均优于全微调基线。

原文摘要 · Abstract (English)

Domain generalization for semantic segmentation aims to mitigate the degradation in model performance caused by domain shifts. However, in many real-world scenarios, we are unable to access the model parameters and architectural details due to privacy concerns and security constraints. Traditional fine-tuning or adaptation is hindered, leading to the demand for input-level strategies that can enhance generalization without modifying model weights. To this end, we propose a \textbf{S}tyle-\textbf{A}daptive \textbf{GE}neralization framework (\textbf{SAGE}), which improves the generalization of frozen models under privacy constraints. SAGE learns to synthesize visual prompts that implicitly align feature distributions across styles instead of directly fine-tuning the backbone. Specifically, we first utilize style transfer to construct a diverse style representation of the source domain, thereby learning a set of style characteristics that can cover a wide range of visual features. Then, the model adaptively fuses these style cues according to the visual context of each input, forming a dynamic prompt that harmonizes the image appearance without touching the interior of the model. Through this closed-loop design, SAGE effectively bridges the gap between frozen model invariance and the diversity of unseen domains. Extensive experiments on five benchmark datasets demonstrate that SAGE achieves competitive or superior performance compared to state-of-the-art methods under privacy constraints and outperforms full fine-tuning baselines in all settings.

领域泛化隐私保护风格迁移分割模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。