arXiv:2409.19933cs.CV2024-09被引 5

轻量级自监督深度估计模型,兼顾精度与可解释性。

CCDepth: A Lightweight Self-supervised Depth Estimation Network with Enhanced Interpretability

论文配图:CCDepth: A Lightweight Self-supervised Depth Estimation Network with Enhanced Interpretability
图 1 · 摘自论文原文
  • 融合CNN与白盒CRATE模块,分别提取局部和全局特征
  • 在KITTI上性能媲美顶尖方法,模型尺寸显著减小
  • 数学可解释的特征提取过程,适合需要透明性的场景

自监督深度估计仅需单目图像序列输入,近年来愈发流行且前景广阔。现有研究多聚焦于提升模型预测精度,但参数量过大阻碍其在边缘设备上的通用部署。此外,新兴神经网络作为黑箱模型,难以分析其决策逻辑,制约了对性能提升机制的理解。为此,本文提出一种新型混合自监督深度估计网络CCDepth,由卷积神经网络(CNN)与白盒CRATE(Coding RAte reduction TransformEr)网络构成。该网络利用CNN提取图像局部信息,用CRATE模块捕获全局特征,从而提升学习效率并减少模型规模。同时,引入CRATE模块使全局特征提取具备数学可解释性。在KITTI数据集上的大量实验表明,所提CCDepth网络性能可媲美当前最先进方法,且模型尺寸显著缩小。进一步的定量与定性分析验证了该方法的有效性。

原文摘要 · Abstract (English)

Self-supervised depth estimation, which solely requires monocular image sequence as input, has become increasingly popular and promising in recent years. Current research primarily focuses on enhancing the prediction accuracy of the models. However, the excessive number of parameters impedes the universal deployment of the model on edge devices. Moreover, the emerging neural networks, being black-box models, are difficult to analyze, leading to challenges in understanding the rationales for performance improvements. To mitigate these issues, this study proposes a novel hybrid self-supervised depth estimation network, CCDepth, comprising convolutional neural networks (CNNs) and the white-box CRATE (Coding RAte reduction TransformEr) network. This novel network uses CNNs and the CRATE modules to extract local and global information in images, respectively, thereby boosting learning efficiency and reducing model size. Furthermore, incorporating the CRATE modules into the network enables a mathematically interpretable process in capturing global features. Extensive experiments on the KITTI dataset indicate that the proposed CCDepth network can achieve performance comparable with those state-of-the-art methods, while the model size has been significantly reduced. In addition, a series of quantitative and qualitative analyses on the inner features in the CCDepth network further confirm the effectiveness of the proposed method.

深度估计自监督轻量化可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。