arXiv:2608.08805cs.CV2026-08

提出LASA框架,提升跨域语义分割的泛化能力

LASA: Language-and-Source-Anchored Alignment for Domain Generalized Semantic Segmentation

论文配图:LASA: Language-and-Source-Anchored Alignment for Domain Generalized Semantic Segmentation
图 1 · 摘自论文原文
  • 用源域特征和视觉语言模型引导风格迁移,保护特征结构
  • 通过类别与域感知签名重校准查询,恢复关键语义细节
  • 适合需要强泛化能力的跨域分割场景

领域泛化语义分割(DGSS)旨在将已标注源域的知识泛化到训练阶段无数据的未见目标域。传统方法采用风格随机化或特征归一化缓解领域偏移,但常损害特征完整性:风格随机化因粒度粗而扭曲特征流形,特征归一化因设计僵硬抑制了有判别性的、域敏感的语义细节。为此,我们提出语言与源锚定对齐(LASA)框架,包含三个协同组件:文本与源引导风格迁移(TSGST)、域感知查询适配器(DAQA)和域感知解码器优化器(DADO)。具体地,TSGST模块利用源特征作为结构锚点,视觉语言模型(VLM)先验作为细粒度引导,缓解流形扭曲;为恢复被抑制的判别性与域敏感细节,DAQA模块通过类别引导与域感知签名重校准对象查询;DADO模块则将生成的查询分布与共享分类器对齐,确保跨域分类响应一致。在多个挑战性基准上的实验证明,该方法显著优于现有最先进方法。

原文摘要 · Abstract (English)

Domain Generalization Semantic Segmentation (DGSS) focuses on generalizing knowledge from labeled source domains to unseen target domains where data is unavailable during the training phase. While conventional methods utilize style randomization or feature normalization to mitigate domain shifts, they often impair feature integrity. Specifically, style randomization distorts the underlying feature manifold due to its coarse-grained nature, while feature normalization suppresses discriminative, domain-sensitive semantic details owing to its rigid design. To address these limitations, we propose the Language-and-Source-Anchored Alignment (LASA) framework, which comprises three synergistic components: Text-and-Source-Guided Style Transfer (TSGST), Domain-Aware Query Adapter (DAQA), and Domain-Aware Decoder Optimizer (DADO). Concretely, the TSGST module addresses manifold distortion by utilizing source features as structural anchors and vision-language model (VLM) priors as fine-grained guidance. To restore suppressed discriminative and domain-sensitive details, the DAQA module recalibrates object queries via categorical guidance and domain-aware signatures, while the DADO module aligns the resulting query distributions with a shared classifier to ensure consistent categorical responses across domains. Extensive experiments on challenging benchmarks demonstrate that our method significantly outperforms state-of-the-art approaches.

语义分割领域泛化视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。