arXiv:2607.10395cs.CV2026-07

无需人工标注,纯自监督训练出高质量抠图模型。

Self-supervised Automatic Matting

论文配图:Self-supervised Automatic Matting
图 1 · 摘自论文原文
  • 用自监督ViT提取语义特征,生成初始抠图提示
  • 通过固定点损失保证抠图与图像颜色一致性,性能媲美全监督模型
  • 首次实现完全无标注的自动抠图,适合大规模图像处理场景

高质量的透明度掩码(alpha matte)标注成本极高,成为深度图像抠图的核心数据瓶颈。尽管先前工作尝试使用粗略标签(如三元图或掩码)降低标注成本,但仍依赖昂贵的逐像素监督,限制了可扩展性和泛化能力。本文提出SSMatte,首次实现仅用RGB图像、无需任何人工标注即可训练出性能媲美全监督模型的自动抠图系统。核心思想是将问题分解为语义锚定与细节抠图两阶段:首先利用冻结的自监督ViT特征,通过基于广义Rayleigh商的新颖语义锚定损失,传播类别标记种子生成语义提示;随后该提示用于锚定细节抠图网络,通过固定点损失优化,强制满足alpha与RGB的一致性。大量实验表明,SSMatte优于现有弱监督方法,在人像基准上达到全监督模型性能,并展现出良好的数据扩展性和泛化能力。本工作推动自动抠图进入全新的全标注自由范式。代码将公开。

原文摘要 · Abstract (English)

High-quality alpha mattes are notoriously expensive to annotate, creating a fundamental data bottleneck for deep image matting. While prior work attempts to reduce annotation cost using coarser labels like trimaps or masks, they remain reliant on costly per-pixel supervision, limiting scalability and generalization. In this work, we push the boundary further and ask: can we train an automatic matting model using only RGB images, with no manual annotation at all? We answer this by presenting SSMatte, a self-supervised framework that for the first time achieves performance on par with fully-supervised automatic matting. Our key insight is to decompose the problem into semantic anchoring and detail matting. SSMatte first generates a semantic matting prompt from frozen self-supervised ViT features by propagating class-token seeds via a novel, training-efficient semantic anchoring loss based on a generalized Rayleigh quotient. This prompt then anchors a detail matting network, which is optimized via a fixed-point-based loss that enforces alpha-RGB consistency. Extensive experiments show SSMatte outperforms prior weakly-supervised methods, matches the performance of fully-supervised models on portrait benchmarks, and demonstrates favorable scaling and generalization behaviors with additional data. Our work pushes automatic matting to an fresh, fully annotation-free paradigm. Code will be available.

图像抠图自监督学习无标注训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。