无需训练即可实现密集图像中个性化实例分割,精度显著提升。
Towards PerSense++: Advancing Training-Free Personalized Instance Segmentation in Dense Images
- 通过密度图生成候选点提示,结合自适应筛选与反馈优化,实现零训练个性化分割。
- 在复杂遮挡场景下,性能超越现有方法,尤其在高密度图像中表现优异。
- 适合需要快速部署个性化分割的视觉应用,如医疗影像、自动驾驶等。
密集视觉场景中的分割面临遮挡、背景杂乱和尺度变化等挑战。为此,我们提出 PerSense,一个端到端、无需训练、模型无关的一次性个性化实例分割框架。PerSense 采用新型实例检测模块(IDM),利用密度图(DMs)生成实例级候选点提示,并通过点提示选择模块(PPSM)结合自适应阈值与空间门控过滤误检。反馈机制自动选取有效样本以提升密度图质量。我们进一步提出 PerSense++,引入三项增强组件:(i) 基于特征与尺度多样性的样本选择策略,提升密度图生成效果;(ii) 融合轮廓与峰值的混合 IDM,改善复杂密度模式下的实例分离;(iii) 无关掩码剔除模块(IMRM),通过异常分析剔除空间不一致的掩码。最后,为支持该未充分探索的任务,我们构建 PerSense-D,一个专用于密集图像个性化分割的基准数据集。多基准上的大量实验表明,PerSense++ 在密集设置下优于现有方法。
原文摘要 · Abstract (English)
Segmentation in dense visual scenes poses significant challenges due to occlusions, background clutter, and scale variations. To address this, we introduce PerSense, an end-to-end, training-free, and model-agnostic one-shot framework for Personalized instance Segmentation in dense images. PerSense employs a novel Instance Detection Module (IDM) that leverages density maps (DMs) to generate instance-level candidate point prompts, followed by a Point Prompt Selection Module (PPSM) that filters false positives via adaptive thresholding and spatial gating. A feedback mechanism further enhances segmentation by automatically selecting effective exemplars to improve DM quality. We additionally present PerSense++, an enhanced variant that incorporates three additional components to improve robustness in cluttered scenes: (i) a diversity-aware exemplar selection strategy that leverages feature and scale diversity for better DM generation; (ii) a hybrid IDM combining contour and peak-based prompt generation for improved instance separation within complex density patterns; and (iii) an Irrelevant Mask Rejection Module (IMRM) that discards spatially inconsistent masks using outlier analysis. Finally, to support this underexplored task, we introduce PerSense-D, a dedicated benchmark for personalized segmentation in dense images. Extensive experiments across multiple benchmarks demonstrate that PerSense++ outperforms existing methods in dense settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。