arXiv:2410.11610cs.CVeess.IV2024-10被引 4

用改进的编码器-解码器结构,提升单目深度估计精度与速度。

Enhanced Encoder-Decoder Architecture for Accurate Monocular Depth Estimation

  • 以Inception-ResNet-v2为编码器,融合多尺度特征提取
  • 在KITTI上推理仅需0.019秒,NYU数据集误差低于0.064
  • 适合实时应用,尤其对高精度深度感知有需求的场景

由于缺乏立体或多视角数据,从单张2D图像估计深度是一项挑战。现有先进架构的主要难点在于高效捕捉复杂物体和细微细节。本文提出一种基于深度学习的新型编码器-解码器结构,首次将Inception-ResNet-v2作为编码器用于单目深度估计,性能优于先前模型。该方法结合多尺度特征提取,提升不同物体尺寸与距离下的预测精度。设计复合损失函数,包含深度损失、梯度边缘损失和结构相似性指数(SSIM)损失,通过微调权重优化加权和,平衡各维度表现。在KITTI数据集上,模型推理时间仅为0.019秒,效率超越视觉变换器,同时保持良好精度;在NYU Depth V2数据集上,达到绝对相对误差(ARE)0.064,均方根误差(RMSE)0.228,δ < 1.25准确率达89.3%。结果表明,该模型在复杂场景中仍能实现高精度、高效率的深度预测,适用于实时应用。

原文摘要 · Abstract (English)

Estimating depth from a single 2D image is a challenging task due to the lack of stereo or multi-view data, which are typically required for depth perception. In state-of-the-art architectures, the main challenge is to efficiently capture complex objects and fine-grained details, which are often difficult to predict. This paper introduces a novel deep learning-based approach using an enhanced encoder-decoder architecture, where the Inception-ResNet-v2 model serves as the encoder. This is the first instance of utilizing Inception-ResNet-v2 as an encoder for monocular depth estimation, demonstrating improved performance over previous models. It incorporates multi-scale feature extraction to enhance depth prediction accuracy across various object sizes and distances. We propose a composite loss function comprising depth loss, gradient edge loss, and Structural Similarity Index Measure (SSIM) loss, with fine-tuned weights to optimize the weighted sum, ensuring a balance across different aspects of depth estimation. Experimental results on the KITTI dataset show that our model achieves a significantly faster inference time of 0.019 seconds, outperforming vision transformers in efficiency while maintaining good accuracy. On the NYU Depth V2 dataset, the model establishes state-of-the-art performance, with an Absolute Relative Error (ARE) of 0.064, a Root Mean Square Error (RMSE) of 0.228, and an accuracy of 89.3% for $δ$ < 1.25. These metrics demonstrate that our model can accurately and efficiently predict depth even in challenging scenarios, providing a practical solution for real-time applications.

单目深度编码器-解码器Inception-ResNet实时推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。