arXiv:2606.09474cs.CV2026-06

不训练模型,用现成工具实现少样本分割,效果超传统方法。

Training-Free Generalized Few-Shot Segmentation through Open-Vocabulary Semantic Arbitration

论文配图:Training-Free Generalized Few-Shot Segmentation through Open-Vocabulary Semantic Arbitration
图 1 · 摘自论文原文
  • 冻结现有模型,通过推理时语义协调完成分割
  • 1次采样在PASCAL5i上达77.9%谐波mIoU,超越训练模型
  • 适合快速部署、无需微调的少样本场景

通用少样本语义分割(GFSS)传统上依赖特定任务的表征学习,需对少量支持样本进行参数调整。近期基础模型已具备强大开集识别与分割能力,提出新问题:能否通过冻结语义先验的推理时协调解决GFSS,而非参数更新?我们提出Open-V框架,结合可提示概念分割(SAM3 PCS)与K次采样的CLIP支持中心,通过校准的逐像素语义仲裁实现无训练的GFSS。该方法无任何可训练组件,推理时支持任意语义类别。研究还发现:支持信息可通过推理时语义定位融入,且当基础模型文本先验在标签无关词汇上减弱时其贡献增强;揭示了基础模型分割中的可复现性混淆问题,即预处理与评估空间不一致会隐性扭曲性能报告。在PASCAL5i、COCO-20i和ADE-OW上验证,证明冻结模型先验的协调机制在常规与开集评估中均具泛化性。在PASCAL-5i(1-shot)上,基类/新类/谐波mIoU分别为78.4%/77.5%/77.9%,无需专门训练即超越最强训练基线+17.7 HM。

原文摘要 · Abstract (English)

Generalized Few-Shot Semantic Segmentation (GFSS) has traditionally been approached as a representation-learning problem, requiring task-specific adaptation to incorporate novel classes from limited support examples. Recent foundation models, however, already exhibit strong open-vocabulary recognition and segmentation capabilities, raising a different question: can GFSS be solved through inference-time coordination of frozen semantic priors rather than parameter adaptation? We answer this question with Open-V, a training-free GFSS framework that combines Segment Anything (SAM3) Promptable Concept Segmentation (PCS) with a K-shot CLIP support centroid through calibrated per-pixel semantic arbitration. OpenV introduces no trainable components and supports arbitrary semantic categories at inference time. Beyond segmentation performance, our study contributes three broader findings. First, we show that support information can be incorporated through inference-time semantic grounding, and that its contribution increases as foundation-model text priors weaken on label-disjoint vocabularies. Second, we identify a reproducibility confound in foundationmodel segmentation, demonstrating that preprocessing and evaluation-space mismatches can silently distort reported performance. Finally, we validate Open-V across PASCAL5i, COCO-20i, and ADE-OW, showing that training-free coordination of foundation-model priors generalizes across both conventional GFSS and open-vocabulary evaluation settings. On PASCAL-5i (1-shot), Open-V attains base/novel/harmonic mIoU of 78.4/77.5/77.9, without GFSS-specific training surpassing the strongest trained baseline by +17.7 HM.

少样本分割无训练基础模型开放词汇

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。