arXiv:2608.15295cs.CV2026-08中稿 · BMVC 2026

无需3D模型,一张图就能精准分割未知物体。

SOS! : A Streamlined Object-Conditional Transformer for Model-free Segmentation

论文配图:SOS! : A Streamlined Object-Conditional Transformer for Model-free Segmentation
图 1 · 摘自论文原文
  • 用单张参考图生成身份锚定的查询,一次前向传播完成分割与识别。
  • 在多个基准上达到新最优,模型效率显著提升。
  • 适合机器人操作等需快速精准分割的场景。

基础分割模型虽能生成高质量、无类别的掩码,却难以将这些候选区域与特定目标物体关联。这种语义鸿沟严重制约其在机器人操作等下游任务中的应用。现有方法依赖复杂的3D物体模型先验,带来高昂计算开销和多阶段流程。为此,我们提出SOS(Streamlined Object-conditional Transformer for model-free Segmentation)。SOS完全摒弃3D模型依赖,仅需每目标一个参考图像。核心是新型物体条件变换器,学习身份锚定的查询,将掩码生成与目标识别统一于一次前向传播。该设计极大提升结构与计算效率。多基准评估表明,SOS在无需模型的未知物体分割任务中建立新基准,实现高精度与高效率兼顾。项目页面与代码见https://sos-seg.github.io/。

原文摘要 · Abstract (English)

Foundation segmentation models excel at generating high-quality, class-agnostic masks, but they struggle to associate these proposals with specific target objects. This semantic gap severely hinders their deployment in downstream applications like robotic manipulation, which demand precise unseen objects segmentation. Existing approaches attempt to resolve this by relying on exhaustive 3D object model priors, inherently introducing prohibitive computational overhead and complex, multi-stage pipelines. To address these limitations, we propose SOS (Streamlined Object-conditional Transformer for model-free Segmentation). SOS completely eliminates the reliance on 3D models, requiring only a single reference image per target object. Central to our framework is a novel Object-Conditional Transformer that learns identity-anchored queries, unifying mask generation and target identification into a single feed-forward pass. This streamlined design drastically improves both structural and computational efficiency. Extensive evaluations across multiple benchmarks demonstrate that SOS establishes a new state-of-the-art for model-free unseen objects segmentation, delivering accurate and high-efficiency performance. The project page and code are available at https://sos-seg.github.io/.

分割物体识别高效模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。