通过多视角渐进适配,提升少样本分割在新领域中的性能
Cross-Domain Few-Shot Segmentation via Multi-view Progressive Adaptation
- 从数据和策略双路径渐进增强,生成更复杂的视图进行训练
- 在多个跨域数据集上实现超过基准方法7.0%的分割精度提升
- 适合需要在小样本、新领域中快速部署分割模型的研究者
跨域少样本分割旨在利用少量示例对数据稀缺领域的类别进行分割。现有方法通常先在大规模源域建立少样本能力,再迁移到目标域,但受限于目标样本数量少且多样性差,性能仍受制约。此外,源域训练模型在目标域初始能力弱,加之显著的域间差异,严重阻碍了目标样本的有效利用。为此,我们提出多视角渐进适配(MPA),从数据与策略双重角度逐步将少样本能力迁移至目标域:(i) 数据层面引入混合渐进增强,通过累积强增广逐步生成更复杂多样的视图,构建更具挑战性的学习场景;(ii) 策略层面设计双链多视图预测,通过顺序与并行学习路径,在广泛监督下充分挖掘这些渐进复杂视图的信息。通过跨多样复杂视图强制预测一致性,MPA 实现了鲁棒且精准的目标域适应。大量实验表明,MPA 显著提升了少样本能力在目标域的迁移效果,相比最先进方法大幅领先(+7.0%)。
原文摘要 · Abstract (English)
Cross-Domain Few-Shot Segmentation aims to segment categories in data-scarce domains conditioned on a few exemplars. Typical methods first establish few-shot capability in a large-scale source domain and then adapt it to target domains. However, due to the limited quantity and diversity of target samples, existing methods still exhibit constrained performance. Moreover, the source-trained model's initially weak few-shot capability in target domains, coupled with substantial domain gaps, severely hinders the effective utilization of target samples and further impedes adaptation. To this end, we propose Multi-view Progressive Adaptation, which progressively adapts few-shot capability to target domains from both data and strategy perspectives. (i) From the data perspective, we introduce Hybrid Progressive Augmentation, which progressively generates more diverse and complex views through cumulative strong augmentations, thereby creating increasingly challenging learning scenarios. (ii) From the strategy perspective, we design Dual-chain Multi-view Prediction, which fully leverages these progressively complex views through sequential and parallel learning paths under extensive supervision. By jointly enforcing prediction consistency across diverse and complex views, MPA achieves both robust and accurate adaptation to target domains. Extensive experiments demonstrate that MPA effectively adapts few-shot capability to target domains, outperforming state-of-the-art methods by a large margin (+7.0%).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。