arXiv:2508.01664cs.CV2025-08被引 2

针对遮挡下的物体完整分割,按形状特征动态分配专家模型。

Shape Distribution Matters: Shape-specific Mixture-of-Experts for Amodal Segmentation under Diverse Occlusions

  • 根据物体形状分布学习潜空间,动态路由至匹配的轻量专家。
  • 在COCOA-cls、KINS等数据集上,遮挡区域分割精度显著提升。
  • 适合处理形变大、遮挡复杂的物体,如衣物与家具。

非可见分割旨在预测包含可见与被遮挡区域的完整物体掩码。该任务因复杂遮挡和极端形状变化(从刚性家具到高度可变形衣物)而极具挑战。现有通用方法依赖单一模型处理所有形状,受限于表征能力,难以捕捉多样化的非可见形状。自然的解决方案是采用混合专家(MoE)框架,为不同形状模式分配专家。然而,若不考虑物体底层形状分布而盲目应用MoE,会导致专家路由错配与专家特化不足,造成冗余或未充分利用。为此,我们提出ShapeMoE,一种面向非可见分割的形状特定稀疏混合专家框架。核心思想是学习一个潜在形状分布空间,并将每个物体动态路由至与其形状特征匹配的轻量级专家。具体而言,ShapeMoE将每个物体编码为紧凑的高斯嵌入,以捕捉关键形状特征;再通过形状感知稀疏路由器将物体映射至最合适的专家,实现精确高效的形状感知路由。每个专家设计为轻量且专精于特定形状模式的遮挡区域预测。ShapeMoE具有清晰的形状-专家对应关系,具备良好可解释性,同时保持高容量与高效性。在COCOA-cls、KINS和D2SA上的实验表明,ShapeMoE持续优于当前最佳方法,尤其在遮挡区域分割上表现突出。代码将公开。

原文摘要 · Abstract (English)

Amodal segmentation targets to predict complete object masks, covering both visible and occluded regions. This task poses significant challenges due to complex occlusions and extreme shape variation, from rigid furniture to highly deformable clothing. Existing one-size-fits-all approaches rely on a single model to handle all shape types, struggling to capture and reason about diverse amodal shapes due to limited representation capacity. A natural solution is to adopt a Mixture-of-Experts (MoE) framework, assigning experts to different shape patterns. However, naively applying MoE without considering the object's underlying shape distribution can lead to mismatched expert routing and insufficient expert specialization, resulting in redundant or underutilized experts. To deal with these issues, we introduce ShapeMoE, a shape-specific sparse Mixture-of-Experts framework for amodal segmentation. The key idea is to learn a latent shape distribution space and dynamically route each object to a lightweight expert tailored to its shape characteristics. Specifically, ShapeMoE encodes each object into a compact Gaussian embedding that captures key shape characteristics. A Shape-Aware Sparse Router then maps the object to the most suitable expert, enabling precise and efficient shape-aware expert routing. Each expert is designed as lightweight and specialized in predicting occluded regions for specific shape patterns. ShapeMoE offers well interpretability via clear shape-to-expert correspondence, while maintaining high capacity and efficiency. Experiments on COCOA-cls, KINS, and D2SA show that ShapeMoE consistently outperforms state-of-the-art methods, especially in occluded region segmentation. The code will be released.

分割遮挡专家网络形状建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。