arXiv:2601.17271cs.CV2026-01

跨投影对齐实现360°单目深度估计,兼顾全局一致与局部清晰。

Cross360: 360° Monocular Depth Estimation via Cross Projections Across Scales

  • 用跨尺度切片投影融合球面与平面特征,提升全局感知。
  • 在多个数据集上超越现有方法,尤其在完整360°图像下表现突出。
  • 适合需要高精度全景深度估计的研究与应用,如VR/AR场景重建。

360°深度估计因球面图像难以保持全局连续性且易产生畸变而具有挑战性。现有方法虽尝试利用多投影互补信息,但在全局与局部一致性间难以平衡;其局部块特征缺乏全局感知,且拼接边界处特征提取差异明显。为此,我们提出Cross360,一种基于交叉注意力的新型架构,结合低畸变切片投影与等距柱状图特征,实现局部与全局信息融合。其跨投影特征对齐模块通过交叉注意力将切片投影特征与等距柱状图的360°视域对齐,确保每块切片都感知全局上下文。此外,渐进式注意力特征聚合模块逐步优化多尺度特征,显著提升深度估计精度。Cross360在多数基准数据集上显著优于现有方法,尤其在完整360°图像条件下表现更优,验证了其在准确、全局一致深度估计上的有效性。代码与模型已公开于https://github.com/huangkun101230/Cross360。

原文摘要 · Abstract (English)

360° depth estimation is a challenging research problem due to the difficulty of finding a representation that both preserves global continuity and avoids distortion in spherical images. Existing methods attempt to leverage complementary information from multiple projections, but struggle with balancing global and local consistency. Their local patch features have limited global perception, and the combined global representation does not address discrepancies in feature extraction at the boundaries between patches. To address these issues, we propose Cross360, a novel cross-attention-based architecture integrating local and global information using less-distorted tangent patches along with equirectangular features. Our Cross Projection Feature Alignment module employs cross-attention to align local tangent projection features with the equirectangular projection's 360° field of view, ensuring each tangent projection patch is aware of the global context. Additionally, our Progressive Feature Aggregation with Attention module refines multi-scaled features progressively, enhancing depth estimation accuracy. Cross360 significantly outperforms existing methods across most benchmark datasets, especially those in which the entire 360° image is available, demonstrating its effectiveness in accurate and globally consistent depth estimation. The code and model are available at https://github.com/huangkun101230/Cross360.

360度深度单目估计跨投影注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。