仅用一个点提示,通过可解释的形状演化实现完整物体分割。
Single Point, Full Mask: Velocity-Guided Level Set Evolution for End-to-End Amodal Segmentation
- 基于点提示构建初始轮廓,通过可微分网络驱动轮廓逐步演化。
- 在COCOA-cls、D2SA、KINS上优于强提示方法,仅需单点输入。
- 模型具几何可解释性,适合需要透明推理的视觉任务场景。
非可视分割旨在恢复完整物体形状,包括无外观信息的遮挡区域,而传统分割仅关注可见部分。现有方法通常依赖强提示(如可见掩码或边界框),在真实场景中获取成本高或不切实际。尽管近期方法如通用分割模型(SAM)支持点提示,但多采用直接掩码回归,未显式建模形状演化,导致复杂遮挡下泛化能力受限。此外,多数方法呈黑箱特性,缺乏几何可解释性,难以揭示遮挡形状的推断机制。为此,本文提出VELA——一种端到端的运动引导水平集非可视分割方法,从点提示出发显式进行轮廓演化。VELA首先根据图像特征与点输入构建初始水平集函数,再由全可微网络预测的形状特异性运动场引导其逐步演变为最终非可视掩码。该网络在每一步学习演化动态,实现几何基础且拓扑灵活的轮廓建模。在COCOA-cls、D2SA和KINS基准上的大量实验表明,VELA在仅需单点提示的情况下超越现有强提示方法,验证了弱提示下可解释几何建模的有效性。代码将公开发布。
原文摘要 · Abstract (English)
Amodal segmentation aims to recover complete object shapes, including occluded regions with no visual appearance, whereas conventional segmentation focuses solely on visible areas. Existing methods typically rely on strong prompts, such as visible masks or bounding boxes, which are costly or impractical to obtain in real-world settings. While recent approaches such as the Segment Anything Model (SAM) support point-based prompts for guidance, they often perform direct mask regression without explicitly modeling shape evolution, limiting generalization in complex occlusion scenarios. Moreover, most existing methods suffer from a black-box nature, lacking geometric interpretability and offering limited insight into how occluded shapes are inferred. To deal with these limitations, we propose VELA, an end-to-end VElocity-driven Level-set Amodal segmentation method that performs explicit contour evolution from point-based prompts. VELA first constructs an initial level set function from image features and the point input, which then progressively evolves into the final amodal mask under the guidance of a shape-specific motion field predicted by a fully differentiable network. This network learns to generate evolution dynamics at each step, enabling geometrically grounded and topologically flexible contour modeling. Extensive experiments on COCOA-cls, D2SA, and KINS benchmarks demonstrate that VELA outperforms existing strongly prompted methods while requiring only a single-point prompt, validating the effectiveness of interpretable geometric modeling under weak guidance. The code will be publicly released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。