arXiv:2603.25131cs.CV2026-03中稿 · CVPR被引 3

无源域适应下提升全景语义分割鲁棒性,解决标注难与数据隐私问题。

Denoise and Align: Towards Source-Free UDA for Robust Panoramic Semantic Segmentation

  • 通过一致性约束与置信度过滤生成高质量伪标签
  • 在城市场景和室内场景分别达到55.04%和70.38% mIoU
  • 适合缺乏源数据访问权限的自动驾驶与虚拟现实应用

全景语义分割对自动驾驶、虚拟现实等关键场景的360°环境理解至关重要。但其发展受限于全景投影带来的严重几何畸变及密集标注的高昂成本。尽管无监督域自适应(UDA)可利用标注丰富的针孔相机数据作为替代,许多实际任务还面临更严格的无源(SFUDA)约束——源数据因隐私或产权不可访问。这一限制加剧了领域偏移问题,导致伪标签不可靠,尤其影响少数类表现。为此,我们提出DAPASS框架,引入两个协同模块实现无需源数据的知识迁移。首先,全景置信度引导去噪(PCGD)模块通过扰动一致性与局部置信度,生成高保真、类别平衡的伪标签;其次,上下文分辨率对抗模块(CRAM)通过对抗性对齐高分辨率细粒度细节与低分辨率全局语义,缓解尺度差异与畸变。DAPASS在室外(Cityscapes-to-DensePASS)和室内(Stanford2D3D)基准上均达领先性能,分别取得55.04%(+2.05%)和70.38%(+1.54%)的mIoU。

原文摘要 · Abstract (English)

Panoramic semantic segmentation is pivotal for comprehensive 360° scene understanding in critical applications like autonomous driving and virtual reality. However, progress in this domain is constrained by two key challenges: the severe geometric distortions inherent in panoramic projections and the prohibitive cost of dense annotation. While Unsupervised Domain Adaptation (UDA) from label-rich pinhole-camera datasets offers a viable alternative, many real-world tasks impose a stricter source-free (SFUDA) constraint where source data is inaccessible for privacy or proprietary reasons. This constraint significantly amplifies the core problems of domain shift, leading to unreliable pseudo-labels and dramatic performance degradation, particularly for minority classes. To overcome these limitations, we propose the DAPASS framework. DAPASS introduces two synergistic modules to robustly transfer knowledge without source data. First, our Panoramic Confidence-Guided Denoising (PCGD) module generates high-fidelity, class-balanced pseudo-labels by enforcing perturbation consistency and incorporating neighborhood-level confidence to filter noise. Second, a Contextual Resolution Adversarial Module (CRAM) explicitly addresses scale variance and distortion by adversarially aligning fine-grained details from high-resolution crops with global semantics from low-resolution contexts. DAPASS achieves state-of-the-art performances on outdoor (Cityscapes-to-DensePASS) and indoor (Stanford2D3D) benchmarks, yielding 55.04% (+2.05%) and 70.38% (+1.54%) mIoU, respectively.

全景分割无源域适应语义分割对抗学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。