arXiv:2605.12006cs.CV2026-05中稿 · CVPR

提升视频目标分割在噪声下的鲁棒性,让模型更可靠。

Robust Promptable Video Object Segmentation

论文配图:Robust Promptable Video Object Segmentation
图 1 · 摘自论文原文
  • 用记忆机制保存对象特征,动态调整每帧分割策略。
  • 在真实和合成噪声数据上,平均性能提升12.3%以上。
  • 适合自动驾驶、医疗影像等对安全要求高的场景。

promptable video object segmentation(PVOS)模型在输入受干扰时性能显著下降,限制了其在安全关键领域的应用。本文首次系统研究鲁棒性PVOS(RobustPVOS),构建了一个包含351段视频片段和超过2500个物体掩码的新基准,涵盖真实世界恶劣条件。同时,通过在现有VOS数据集上施加多样且时变的噪声生成合成训练数据。提出一种新方法MoGA(Memory-object-conditioned Gated-rank Adaptation),其核心在于利用跨帧记忆中的对象特定表示,实现对每个追踪对象差异化处理,并保持预测的时间一致性。在该基准上的大量实验验证了MoGA的有效性,在合成与真实数据集上对多种噪声类型均取得一致且显著的性能提升,为未来研究建立了强基线。基准数据已公开:https://sohyun-l.github.io/RobustPVOS_project_page/

原文摘要 · Abstract (English)

The performance of promptable video object segmentation (PVOS) models substantially degrades under input corruptions, which prevents PVOS deployment in safety-critical domains. This paper offers the first comprehensive study on robust PVOS (RobustPVOS). We first construct a new, comprehensive benchmark with two real-world evaluation datasets of 351 video clips and more than 2,500 object masks under real-world adverse conditions. At the same time, we generate synthetic training data by applying diverse and temporally varying corruptions to existing VOS datasets. Moreover, we present a new RobustPVOS method, dubbed Memory-object-conditioned Gated-rank Adaptation (MoGA). The key to successfully performing RobustPVOS is two-fold: effectively handling object-specific degradation and ensuring temporal consistency in predictions. MoGA leverages object-specific representations maintained in memory across frames to condition the robustification process, which allows the model to handle each tracked object differently in a temporally consistent way. Extensive experiments on our benchmark validate MoGA's efficacy, showing consistent and significant improvements across diverse corruption types on both synthetic and real-world datasets, establishing a strong baseline for future RobustPVOS research. Our benchmark is publicly available at https://sohyun-l.github.io/RobustPVOS_project_page/.

视频分割鲁棒性记忆机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。