提出几何结构耦合方法,提升全景图像中显著目标检测精度。
SphereSOD: Geometry-Structure Coupled Learning for 360 Salient Object Detection

- 基于球面投影几何动态采样,自适应调整特征位置
- 通过结构引导上下文聚合,实现边界精确重建
- 直接在平面投影域推理,效率高且保留原始结构
360°显著目标检测旨在对全视角范围内的显著区域进行精确分割。然而,等距柱状投影(ERP)在将球面域映射到平面时引入严重空间失真。现有方法主要关注补偿投影失真,却忽略了全景几何与显著目标结构在特征感知和预测优化过程中的交互作用。为此,我们提出SphereSOD,一种原生支持ERP的框架,将全景几何与不断演化的显著结构耦合。具体而言,球面几何控制特征采样与空间加权,而粗粒度显著性与轮廓预测则影响渐进解码过程中的上下文聚合。SphereSOD首先基于球面投影几何初始化可变形采样,并采用有界、内容自适应偏移,使特征更契合底层全景几何;随后,解码器执行结构引导的上下文聚合与渐进式细化,以恢复完整的显著区域和精确边界。在三个公开360° SOD基准上的大量实验表明,该方法达到当前最优性能,兼具良好准确率与效率,支持直接在ERP空间进行保结构推理,为替代传统重投影的全景处理流程提供了有力候选方案。
原文摘要 · Abstract (English)
360{\deg} salient object detection (SOD) aims to accurately segment salient regions across a full field of view. However, equirectangular projection (ERP) introduces severe spatial distortion when mapping the spherical domain onto a planar representation. Existing methods mainly focus on compensating projection distortion while overlooking the interaction between panoramic geometry and salient object structure during feature perception and prediction refinement. To this end, we propose SphereSOD, an ERP-native framework that couples panoramic geometry with evolving salient structures. Specifically, spherical geometry governs feature sampling and spatial weighting, while coarse-grained saliency and contour prediction influence context aggregation during the progressive decoding process. SphereSOD first initializes deformable sampling based on spherical projection geometry and then employs bounded, content-adaptive offsets, yielding features that are better aligned with the underlying panoramic geometry. Subsequently, the decoder performs structure-guided context aggregation and progressive refinement to recover complete salient regions and accurate boundaries. Extensive experiments on three public 360{\deg} SOD benchmarks demonstrate state-of-the-art performance and a favorable accuracy-efficiency trade-off, supporting structurepreserving inference directly in ERP space as a promising alternative to projection-heavy panoramic pipelines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。