用潜在空间特征提升单目深度估计精度,改善边界模糊问题。
Deep Neural Networks for Accurate Depth Estimation with Latent Space Features
- 双编码器-解码器结构,支持颜色到深度与深度到深度转换。
- 引入隐空间损失与梯度损失,显著减少深度边界模糊。
- 在NYU Depth V2数据集上达到新基准,适合机器人导航场景。
深度估计在提升人机交互中起关键作用,尤其在需精确三维场景重建的室内环境中,对导航与物体操作至关重要。单目深度估计依赖单个RGB相机,相比立体相机或激光雷达更具成本优势。然而,现有方法仍难以准确刻画深度边界,导致重建精度不足。本文提出一种新框架,利用深度卷积神经网络中的潜在空间特征,增强单目深度图的精度。模型采用双编码器-解码器结构,支持颜色到深度及深度到深度的变换,通过潜在空间编码实现深度优化。为提升深度边界和局部特征精度,设计了一种结合隐空间损失与梯度损失的新损失函数,有助于保持深度边界的完整性。在NYU Depth V2数据集上进行充分测试,该框架在复杂室内场景中表现优异,创下新基准。结果表明,该方法有效降低深度模糊与歧义,是人机交互与三维场景重建的有前景解决方案。
原文摘要 · Abstract (English)
Depth estimation plays a pivotal role in advancing human-robot interactions, especially in indoor environments where accurate 3D scene reconstruction is essential for tasks like navigation and object handling. Monocular depth estimation, which relies on a single RGB camera, offers a more affordable solution compared to traditional methods that use stereo cameras or LiDAR. However, despite recent progress, many monocular approaches struggle with accurately defining depth boundaries, leading to less precise reconstructions. In response to these challenges, this study introduces a novel depth estimation framework that leverages latent space features within a deep convolutional neural network to enhance the precision of monocular depth maps. The proposed model features dual encoder-decoder architecture, enabling both color-to-depth and depth-to-depth transformations. This structure allows for refined depth estimation through latent space encoding. To further improve the accuracy of depth boundaries and local features, a new loss function is introduced. This function combines latent loss with gradient loss, helping the model maintain the integrity of depth boundaries. The framework is thoroughly tested using the NYU Depth V2 dataset, where it sets a new benchmark, particularly excelling in complex indoor scenarios. The results clearly show that this approach effectively reduces depth ambiguities and blurring, making it a promising solution for applications in human-robot interaction and 3D scene reconstruction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。