arXiv:2507.18944cs.CVeess.IV2025-07ICCV被引 5

提出OASIS方法,通过结构优化提升视频物体分割边界精度。

Structure Matters: Revisiting Boundary Refinement in Video Object Segmentation

  • 融合Canny边缘先验与对象特征,生成结构图并强化边界表示。
  • 在DAVIS-17上达到91.6的F值,YouTubeVOS上达86.6的G值。
  • 适用于高相似度或遮挡场景,兼顾精度与48 FPS实时速度。

给定初始对象掩码,半监督视频对象分割(SVOS)旨在跨视频帧跟踪并分割该对象,是计算机视觉中的基础任务。尽管近期基于记忆的方法展现出潜力,但在存在遮挡、对象交互或高特征相似性的场景中仍表现不佳。为解决这些问题并满足下游应用的实时需求,本文提出一种具有内在结构精修能力的边界修正视频对象分割方法——OASIS。具体而言,设计了一个轻量级结构精修模块,结合由Canny算子捕捉的粗略边缘先验与存储的对象特征,生成对象级结构图,并通过突出边界特征来优化表示。引入确信度学习以估计不确定性,进一步应对遮挡区域的挑战。所提方法OASIS保持高效设计,大量实验表明其在挑战性基准上性能优于现有最先进方法:在DAVIS-17验证集上取得91.6的F值(对比89.7),在YouTubeVOS 2019验证集上取得86.6的G值(对比86.2),同时在DAVIS上维持48 FPS的推理速度。

原文摘要 · Abstract (English)

Given an object mask, Semi-supervised Video Object Segmentation (SVOS) technique aims to track and segment the object across video frames, serving as a fundamental task in computer vision. Although recent memory-based methods demonstrate potential, they often struggle with scenes involving occlusion, particularly in handling object interactions and high feature similarity. To address these issues and meet the real-time processing requirements of downstream applications, in this paper, we propose a novel bOundary Amendment video object Segmentation method with Inherent Structure refinement, hereby named OASIS. Specifically, a lightweight structure refinement module is proposed to enhance segmentation accuracy. With the fusion of rough edge priors captured by the Canny filter and stored object features, the module can generate an object-level structure map and refine the representations by highlighting boundary features. Evidential learning for uncertainty estimation is introduced to further address challenges in occluded regions. The proposed method, OASIS, maintains an efficient design, yet extensive experiments on challenging benchmarks demonstrate its superior performance and competitive inference speed compared to other state-of-the-art methods, i.e., achieving the F values of 91.6 (vs. 89.7 on DAVIS-17 validation set) and G values of 86.6 (vs. 86.2 on YouTubeVOS 2019 validation set) while maintaining a competitive speed of 48 FPS on DAVIS.

视频分割边界精修结构建模实时处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。