arXiv:2506.21198cs.CVcs.RO2025-06ICCV被引 4

无需源数据即可实现全景图遮挡感知的无缝分割,提升全景视觉理解能力。

Unlocking Constraints: Source-Free Occlusion-Aware Seamless Segmentation

  • 提出无源遮挡感知全景分割新任务,无需源数据或目标标签
  • 在真实与合成数据间迁移中达到10.9的mAAP和11.6的mAP,优于源仅有方法4.3点
  • 适合全景图像处理、自动驾驶等需全视角理解的场景

全景图像处理对全场景感知至关重要,但受限于畸变、透视遮挡及标注不足。以往无监督域适应方法需访问有标签的针孔数据,我们提出更实用的新任务——无源遮挡感知无缝分割(SFOASS),并给出首个解决方案UNLOCK。该框架包含全景伪标签学习与非可视驱动上下文学习两个模块,在不依赖源数据或目标标签的前提下,实现360°视角覆盖与遮挡感知分割。我们在真实到真实及合成到真实两种设置下构建基准测试,实验表明该方法性能媲美依赖源数据的方法,取得10.9的mAAP和11.6的mAP,且比仅用源数据的方法提升4.3点(mAPQ)。所有数据与代码将公开于https://github.com/yihong-97/UNLOCK。

原文摘要 · Abstract (English)

Panoramic image processing is essential for omni-context perception, yet faces constraints like distortions, perspective occlusions, and limited annotations. Previous unsupervised domain adaptation methods transfer knowledge from labeled pinhole data to unlabeled panoramic images, but they require access to source pinhole data. To address these, we introduce a more practical task, i.e., Source-Free Occlusion-Aware Seamless Segmentation (SFOASS), and propose its first solution, called UNconstrained Learning Omni-Context Knowledge (UNLOCK). Specifically, UNLOCK includes two key modules: Omni Pseudo-Labeling Learning and Amodal-Driven Context Learning. While adapting without relying on source data or target labels, this framework enhances models to achieve segmentation with 360° viewpoint coverage and occlusion-aware reasoning. Furthermore, we benchmark the proposed SFOASS task through both real-to-real and synthetic-to-real adaptation settings. Experimental results show that our source-free method achieves performance comparable to source-dependent methods, yielding state-of-the-art scores of 10.9 in mAAP and 11.6 in mAP, along with an absolute improvement of +4.3 in mAPQ over the source-only method. All data and code will be made publicly available at https://github.com/yihong-97/UNLOCK.

全景分割无源域适应遮挡感知视觉理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。