arXiv:2507.12008cs.CVcs.AI2025-07中稿 · ICML被引 4

提出新方法,让模型跨域分割更准,无需预训练

Dual form Complementary Masking for Domain-Adaptive Image Segmentation

  • 用互补掩码重构图像,挖掘跨域共性特征
  • 在自然与生物图像上分割精度显著超越基线
  • 端到端训练,无需额外预训练,适合医疗等场景

近期研究将掩码图像建模(MIM)与无监督域自适应(UDA)中的一致性正则化关联,但仅将掩码视为输入图像的变形形式,缺乏理论分析,导致对掩码重建的理解肤浅,未能充分挖掘其在特征提取与表征学习中的潜力。本文将掩码重建重新建模为稀疏信号重建问题,并理论证明互补掩码的对偶形式在提取域无关特征方面具有优越性。基于此洞察,提出简单高效的MaskTwins框架,将掩码重建直接融入主训练流程。该方法通过强制互补掩码图像的预测一致性,揭示跨不同域的内在结构模式,实现端到端的域泛化。大量实验验证,MaskTwins在自然图像与生物图像分割任务中均优于基线方法。结果表明,该方法无需单独预训练即可有效提取域不变特征,为域自适应分割提供了新范式。

原文摘要 · Abstract (English)

Recent works have correlated Masked Image Modeling (MIM) with consistency regularization in Unsupervised Domain Adaptation (UDA). However, they merely treat masking as a special form of deformation on the input images and neglect the theoretical analysis, which leads to a superficial understanding of masked reconstruction and insufficient exploitation of its potential in enhancing feature extraction and representation learning. In this paper, we reframe masked reconstruction as a sparse signal reconstruction problem and theoretically prove that the dual form of complementary masks possesses superior capabilities in extracting domain-agnostic image features. Based on this compelling insight, we propose MaskTwins, a simple yet effective UDA framework that integrates masked reconstruction directly into the main training pipeline. MaskTwins uncovers intrinsic structural patterns that persist across disparate domains by enforcing consistency between predictions of images masked in complementary ways, enabling domain generalization in an end-to-end manner. Extensive experiments verify the superiority of MaskTwins over baseline methods in natural and biological image segmentation. These results demonstrate the significant advantages of MaskTwins in extracting domain-invariant features without the need for separate pre-training, offering a new paradigm for domain-adaptive segmentation.

图像分割域自适应掩码建模端到端

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。