解决跨域少样本分割中语义与属性对齐过强问题,提升新类别分割精度。
Hierarchical Spatial and Channel Aggregation for Cross-domain Few-shot Segmentation

- 分层空间与通道聚合,缓解语义和属性过度对齐
- 动态构建概率语义库,用伪原型补充支持信息
- 在4个数据集上达到当前最优效果,适合跨域分割场景
跨域少样本分割(CD-FSS)旨在利用源域的大量标注样本学习通用分割能力,从而在目标域仅提供少量标注样本时实现对新类别的准确分割。现有方法主要关注缓解由风格差异引起的特征分布偏移,却忽略了不同域间类别语义粒度和判别性特征的显著差异,导致支持-查询匹配出现语义过对齐和属性过对齐两大问题。为此,本文提出双分层聚合网络(DHANet),包含三个核心模块:首先,分层空间聚合(HSA)模块沿空间维度进行多尺度区域聚合,生成分层语义增强特征,缓解语义过对齐;其次,分层通道聚合(HCA)模块沿通道维度进行多尺度属性聚合,生成分层属性增强特征,缓解属性过对齐;最后,提出在线概率语义库(OPSB),在推理过程中逐步构建并更新查询预测的类别概率分布,采样多个伪原型作为额外支持信息,缓解支持样本不足问题。在四个目标域数据集上的大量实验表明,本方法取得当前最优性能。
原文摘要 · Abstract (English)
Cross-domain Few-shot Segmentation (CD-FSS) aims to learn generalizable segmentation capability from abundant annotated samples in the source domain, enabling accurate segmentation of novel classes in the target domain with only a few annotated samples. Existing CD-FSS methods mainly focus on mitigating feature distribution shifts caused by style gaps while ignoring significant differences in class semantic granularity and discriminative attributes across domains, leading to two key degradations in support-query matching: semantic over-alignment and attribute over-alignment. To this end, we propose the Dual Hierarchical Aggregation Network (DHANet), which comprises three key modules. First, the Hierarchical Spatial Aggregation (HSA) module performs multi-scale region aggregation of pixel features along the spatial dimension, generating hierarchical semantic-enhanced features to alleviate semantic over-alignment. Additionally, the HCA module conducts multi-scale attribute aggregation along the channel dimension, generating hierarchical attribute-enhanced features to mitigate attribute over-alignment. Finally, we propose the Online Probabilistic Semantic Bank (OPSB), which progressively constructs and updates class probability distributions from query predictions during inference, and samples multiple pseudo-prototypes as additional support information to mitigate insufficient support. Extensive experiments on four target-domain datasets demonstrate that our method achieves state-of-the-art performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。