用可学习的形状原型+自适应注入,精准补全被遮挡物体轮廓。
Learnable Shape Prototypes with Occlusion-Geometry-Guided Injection for Amodal Instance Segmentation

- 通过交叉注意力动态组合可学习原型生成实例化形状先验。
- 在遮挡区域的平均交并比提升超11个百分点,参数量仅为三分之一。
- 适合需要高精度遮挡补全的视觉理解任务,如自动驾驶场景解析。
无可见像素观测的遮挡区域需依赖形状先验进行推断,现有方法使用固定容量编码或昂贵生成模型,且在所有空间位置均匀注入先验。本文提出一种门控可靠性自适应形状先验框架:引入形状先验记忆模块,通过交叉注意力动态组合可学习原型,实现实例自适应的先验融合;空间自适应可靠性门基于可见掩码的符号距离场调节各位置注入强度,保留可见区域可靠特征,将形状补偿聚焦于遮挡区。在两个主流基准测试中,所提方法在多种评估设置下均优于现有方法,标准设置下某基准上遮挡区域的平均交并比提升超过11个百分点,同时总参数量约为三分之一。线性探针分析显示,可见掩码交叉注意力模块隐式将遮挡几何信息编码至视觉令牌表示中,解释了模块分解的有效性。
原文摘要 · Abstract (English)
Amodal instance segmentation aims to predict the complete object mask including occluded regions that lack pixel-level observations and must be inferred with the aid of shape priors. Existing methods acquire shape priors through fixed-capacity encoding spaces or expensive generative models, and inject them uniformly across all spatial positions without adapting to the varying prior demand between visible and occluded regions. In this paper, we propose a gated reliability-adaptive shape prior framework, which introduces a shape prior memory module that combines learnable prototypes via cross-attention to produce instance-adaptive shape priors through weighted prototype combination rather than generation. A spatial adaptive reliability gate then employs the signed distance field of the visible mask to modulate injection intensity at each position according to its occlusion depth, preserving reliable features in visible regions while directing shape compensation toward occluded areas. Experiments on two mainstream amodal instance segmentation benchmarks demonstrate that the proposed method outperforms existing approaches under multiple evaluation settings, improving the mean intersection-over-union over occluded regions by over 11 percentage points on one of the two benchmarks under the standard setting, while using approximately one-third of the total parameters. Linear probing analysis further reveals that the visible-mask cross-attention module implicitly encodes occlusion geometry into visual token representations, explaining the effectiveness of the proposed module decomposition.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。