arXiv:2603.27206cs.CV2026-03被引 1

用生成模型提升少样本分割的类别覆盖与标签精度

Make It Up: Fake Images, Real Gains in Generalized Few-shot Semantic Segmentation

论文配图:Make It Up: Fake Images, Real Gains in Generalized Few-shot Semantic Segmentation
图 1 · 摘自论文原文
  • 构建去重提示库,生成多样且类一致的假图像
  • 两阶段优化伪标签,提升边界精度和区域可靠性
  • 适合需要高质量分割结果的少样本视觉任务

通用少样本语义分割(GFSS)受限于新类别标注稀缺导致的外观覆盖不足。尽管扩散模型可大规模生成新类别图像,但因掩码不可靠或缺失,实际效果常受噪声监督影响。本文提出Syn4Seg框架,通过生成增强提升新类别覆盖并改善伪标签质量:首先基于嵌入去重构建每个新类别的提示库,生成多样化且类一致的合成图像;其次采用两阶段伪标签估计,先过滤低一致性区域以获取高精度种子,再结合全局(支持图)与局部(图像)统计信息自适应重标记不确定像素;最后仅对边界带和未标记像素进行约束性SAM更新,避免高置信区域被覆盖,提升轮廓保真度。在PASCAL-$5^i$和COCO-$20^i$上的大量实验表明,1-shot与5-shot设置下均有稳定提升,验证了合成数据在生成可靠掩码与精确边界的可扩展路径。

原文摘要 · Abstract (English)

Generalized few-shot semantic segmentation (GFSS) is fundamentally limited by the coverage of novel-class appearances under scarce annotations. While diffusion models can synthesize novel-class images at scale, practical gains are often hindered by insufficient coverage and noisy supervision when masks are unavailable or unreliable. We propose Syn4Seg, a generation-enhanced GFSS framework designed to expand novel-class coverage while improving pseudo-label quality. Syn4Seg first maximizes prompt-space coverage by constructing an embedding-deduplicated prompt bank for each novel class, yielding diverse yet class-consistent synthetic images. It then performs support-guided pseudo-label estimation via a two-stage refinement that i) filters low-consistency regions to obtain high-precision seeds and ii) relabels uncertain pixels with image-adaptive prototypes that combine global (support) and local (image) statistics. Finally, we refine only boundary-band and unlabeled pixels using a constrained SAM-based update to improve contour fidelity without overwriting high-confidence interiors. Extensive experiments on PASCAL-$5^i$ and COCO-$20^i$ demonstrate consistent improvements in both 1-shot and 5-shot settings, highlighting synthetic data as a scalable path for GFSS with reliable masks and precise boundaries.

少样本分割生成模型伪标签优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。