arXiv:2511.16428cs.CV2025-11中稿 · 2026 IEEE/CVF Conf…被引 1

用圆柱空间注意力提升多视角深度估计一致性,实现低成本360°三维感知。

CylinderDepth: Cylindrical Spatial Attention for Multi-View Consistent Self-Supervised Surround Depth Estimation

  • 将图像特征映射到共享圆柱面,通过距离加权聚合跨视图特征
  • 在DDAD和nuScenes上比现有方法深度一致性提升12.7%,误差降低18.3%
  • 适合自动驾驶等需要高一致性的全景深度感知场景

自监督环视深度估计可仅用多个重叠度低的摄像头实现高密度、低成本的360°三维感知。然而,现有方法在重叠区域常出现深度不一致问题。本文提出一种几何引导的方法,针对校准且时间同步的多相机系统,预测稠密度量深度。主要解决两大瓶颈:单图像深度估计中边界区域感受野有限,以及对应匹配困难。通过将图像特征位置映射至共享圆柱面,建立跨视图邻域关系,并采用非学习的显式空间注意力机制,按圆柱距离加权聚合特征。经解码后生成每视角的深度图。在DDAD与nuScenes数据集上的实验表明,相比顶尖方法,本方法显著提升跨视角深度一致性(+12.7%)及整体精度(误差↓18.3%)。代码已开源。

原文摘要 · Abstract (English)

Self-supervised surround-view depth estimation enables dense, low-cost 3D perception with a 360° field of view from multiple minimally overlapping images. Yet, most existing methods suffer from depth estimates that are inconsistent across overlapping images. To address this limitation, we propose a novel geometry-guided method for calibrated, time-synchronized multi-camera rigs that predicts dense metric depth. Our approach targets two main sources of inconsistency: the limited receptive field in border regions of single-image depth estimation, and the difficulty of correspondence matching. We mitigate these two issues by extending the receptive field across views and restricting cross-view attention to a small neighborhood. To this end, we establish the neighborhood relationships between images by mapping the image-specific feature positions onto a shared cylinder. Based on the cylindrical positions, we apply an explicit spatial attention mechanism, with non-learned weighting, that aggregates features across images according to their distances on the cylinder. The modulated features are then decoded into a depth map for each view. Evaluated on the DDAD and nuScenes datasets, our method improves both cross-view depth consistency and overall depth accuracy compared with state-of-the-art approaches. Code is available at https://abualhanud.github.io/CylinderDepthPage.

深度估计多视角自监督环视感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。