解决弱标注支持图中的干扰问题,提升少样本分割精度。
SADe: Sparse-Atom Support Decontamination for Few-Shot Segmentation with Weak Support Annotations

- 用稀疏自编码器原子激活差异判断支持块可靠性
- 在九组提示中六组达到最高查询mIoU,箱型标注下提升超11点
- 可插件式集成,适配多种模型与标注类型
少样本分割通常依赖像素级干净的支持掩码,但实际标注常为框、涂鸦、粗掩码或伪掩码,易混入纹理相似的干扰物和背景。本文提出SADe,一种不依赖查询信息的支持去噪层,通过稀疏自编码器的原子激活对比来估计支持块可靠性:密集相似性可能响应目标与纹理相似背景,而原子在弱标注内外的激活差异提供因子级可靠性线索。轻量级路由结合原子证据、密集相似性和任务统计,预测块可靠性并生成清理后支持掩码。在FSS-1000合成弱标注上训练一次后冻结,适用于所有目标评估。结果在六组独立提示组合中达最高查询mIoU;使用相同ProMi头时,在紧框下与SAM3掩码相当,于box-r2/r4分别领先11.17和19.49点。作为插件,在4个冻结下游模型、2个数据集上70/72的框族比较中优于原始支持;点与涂鸦提示下性能接近原始基线。消融实验表明原子证据提供超越密集相似性的可靠性信息。
原文摘要 · Abstract (English)
Few-shot segmentation (FSS) commonly assumes clean pixel-level support masks, yet practical support supervision often uses boxes, scribbles, coarse masks, or pseudo-masks. These weak annotations may include texture-similar distractors and background context alongside the target, contaminating class prototypes or visual prompts before query prediction. We introduce SADe, a predictor-agnostic support decontamination layer that estimates the reliability of selected support patches without query information. Central to SADe is sparse autoencoder (SAE) atom evidence: dense similarity may respond to both target and texture-similar context, whereas contrasting atom activations inside and outside the weak-support region provides factor-level reliability cues. A lightweight router combines atom evidence with dense similarity and episode statistics to predict patch reliability and generate a cleaned support mask. Trained once on synthetic weak-support episodes from FSS-1000, the router is frozen for all target evaluations. The resulting mask supports standalone prediction or can be supplied to heterogeneous FSS models through native support interfaces without altering query-side inference. Under a matched weak-support protocol, SADe achieves the highest query mIoU in six of nine standalone prompt-shot combinations. With the same ProMi query head, it is within 0.03 mIoU of SAM3-derived masks under tight boxes and surpasses them by 11.17 and 19.49 points under box-r2 and box-r4, respectively. As a plug-in, SADe improves over raw support in 70 of 72 matched box-family comparisons across four frozen downstream models and two datasets. On point and scribble prompts, its average performance remains close to the corresponding raw-support baseline. Ablations and atom-removal controls show that atom evidence contributes reliability information beyond dense similarity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。