arXiv:2509.05599cs.RO2025-09被引 1

用单目相机检测3D玻璃,结合平面几何与自适应特征融合。

MonoGlass3D: Monocular 3D Glass Detection with Plane Regression and Adaptive Feature Fusion

  • 设计自适应特征融合模块,应对玻璃外观模糊和场景多变。
  • 提出平面回归管道,利用玻璃表面的几何特性提升检测精度。
  • 在真实场景数据集上验证,优于当前最佳方法。

在3D环境中检测并定位玻璃对视觉感知系统构成重大挑战,因玻璃的光学特性常使传统传感器难以准确区分玻璃表面。现有真实世界中针对玻璃物体的数据集匮乏,制约了该领域进展。为此,我们构建了一个新数据集,涵盖多种玻璃配置,并带有精确的3D标注,数据来自不同真实场景。基于此,我们提出MonoGlass3D,一种适用于多样化环境下的单目3D玻璃检测新方法。为克服玻璃外观模糊及上下文多样性带来的难题,我们设计了自适应特征融合模块,使网络能有效捕捉不同条件下的上下文信息。此外,为利用玻璃表面独特的平面几何特性,我们提出平面回归流程,实现几何属性在框架内的无缝集成。大量实验表明,该方法在玻璃分割和单目深度估计任务上均超越现有最先进方法。结果凸显了结合几何与上下文线索在透明表面理解中的优势。

原文摘要 · Abstract (English)

Detecting and localizing glass in 3D environments poses significant challenges for visual perception systems, as the optical properties of glass often hinder conventional sensors from accurately distinguishing glass surfaces. The lack of real-world datasets focused on glass objects further impedes progress in this field. To address this issue, we introduce a new dataset featuring a wide range of glass configurations with precise 3D annotations, collected from distinct real-world scenarios. On the basis of this dataset, we propose MonoGlass3D, a novel approach tailored for monocular 3D glass detection across diverse environments. To overcome the challenges posed by the ambiguous appearance and context diversity of glass, we propose an adaptive feature fusion module that empowers the network to effectively capture contextual information in varying conditions. Additionally, to exploit the distinct planar geometry of glass surfaces, we present a plane regression pipeline, which enables seamless integration of geometric properties within our framework. Extensive experiments demonstrate that our method outperforms state-of-the-art approaches in both glass segmentation and monocular glass depth estimation. Our results highlight the advantages of combining geometric and contextual cues for transparent surface understanding.

3D检测玻璃识别单目视觉几何建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。