arXiv:2507.21367cs.CV2025-07ICCV被引 3

通过概率扩散建模提升语义分割在未知场景下的泛化能力

Exploring Probabilistic Modeling Beyond Domain Generalization for Semantic Segmentation

  • 引入隐变量域先验,用概率扩散框架建模域偏移
  • 在多个城市场景上实现显著优于基线的分割准确率
  • 适用于需要强泛化能力的自动驾驶与遥感图像分析

领域泛化语义分割(DGSS)是关键但极具挑战的任务,因未见环境中的域偏移会严重降低模型性能。现有方法通过将特征投影至源域来增强对齐,却常忽视内在的潜在域先验,导致效果受限。本文提出概率扩散对齐框架PDAF,通过概率扩散建模提升现有分割网络的泛化能力。PDAF引入隐变量域先验(LDP)以捕捉域偏移,并将其作为条件因子对齐源域与未见目标域。该框架集成于预训练分割模型,利用成对的源图像与伪目标图像模拟潜在域偏移,实现LDP建模。包含三个模块:隐变量先验提取器(LPE)通过监督域偏移预测LDP;域补偿模块(DCM)调整特征表示以缓解域偏移;扩散先验估计器(DPE)利用扩散过程估计LDP,无需配对样本。该设计可迭代建模域偏移,逐步优化特征表示,在复杂目标条件下提升泛化能力。大量实验验证了PDAF在多样化且具挑战性的城市场景中的有效性。

原文摘要 · Abstract (English)

Domain Generalized Semantic Segmentation (DGSS) is a critical yet challenging task, as domain shifts in unseen environments can severely compromise model performance. While recent studies enhance feature alignment by projecting features into the source domain, they often neglect intrinsic latent domain priors, leading to suboptimal results. In this paper, we introduce PDAF, a Probabilistic Diffusion Alignment Framework that enhances the generalization of existing segmentation networks through probabilistic diffusion modeling. PDAF introduces a Latent Domain Prior (LDP) to capture domain shifts and uses this prior as a conditioning factor to align both source and unseen target domains. To achieve this, PDAF integrates into a pre-trained segmentation model and utilizes paired source and pseudo-target images to simulate latent domain shifts, enabling LDP modeling. The framework comprises three modules: the Latent Prior Extractor (LPE) predicts the LDP by supervising domain shifts; the Domain Compensation Module (DCM) adjusts feature representations to mitigate domain shifts; and the Diffusion Prior Estimator (DPE) leverages a diffusion process to estimate the LDP without requiring paired samples. This design enables PDAF to iteratively model domain shifts, progressively refining feature representations to enhance generalization under complex target conditions. Extensive experiments validate the effectiveness of PDAF across diverse and challenging urban scenes.

语义分割域泛化概率建模扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。