arXiv:2505.00980cs.CV2025-05被引 3

轻量级深度网络LMDepth用Mamba替代Transformer,适合边缘设备部署。

LMDepth: Lightweight Mamba-based Monocular Depth Estimation for Real-World Deployment

  • 用改进的金字塔池化模块提取多尺度上下文信息
  • 引入Mamba块实现低计算量全局特征解码,精度高于同类轻量模型
  • 在嵌入式平台支持INT8量化,适合真实场景边缘应用

单目深度估计为RGB图像增加深度维度,在虚拟现实、自动驾驶和机器人导航中广泛应用。然而,现有方法难以在性能与计算效率间取得平衡,制约了在资源受限设备上的部署。为此,我们提出LMDepth,一种基于Mamba的轻量级单目深度估计网络,可在保持低计算开销的同时重建高精度深度信息。具体而言,设计了一种改进的金字塔空间池化模块,作为多尺度特征聚合器与上下文提取器,确保准确深度估计所需的全局空间信息。同时,在解码器中集成多个深度Mamba块,利用线性计算机制,高效从全局特征中解码深度信息,相比依赖复杂注意力机制的Transformer架构更轻量。在NYUDv2和KITTI数据集上的大量实验表明,相较于以往轻量级深度估计方法,LMDepth以更少参数和更低计算复杂度(以GFLOPs衡量)达到更高性能。进一步在嵌入式平台进行INT8量化部署,验证了其在真实世界边缘应用中的实用性。

原文摘要 · Abstract (English)

Monocular depth estimation provides an additional depth dimension to RGB images, making it widely applicable in various fields such as virtual reality, autonomous driving and robotic navigation. However, existing depth estimation algorithms often struggle to effectively balance performance and computational efficiency, which poses challenges for deployment on resource-constrained devices. To address this, we propose LMDepth, a lightweight Mamba-based monocular depth estimation network, designed to reconstruct high-precision depth information while maintaining low computational overhead. Specifically, we propose a modified pyramid spatial pooling module that serves as a multi-scale feature aggregator and context extractor, ensuring global spatial information for accurate depth estimation. Moreover, we integrate multiple depth Mamba blocks into the decoder. Designed with linear computations, the Mamba Blocks enable LMDepth to efficiently decode depth information from global features, providing a lightweight alternative to Transformer-based architectures that depend on complex attention mechanisms. Extensive experiments on the NYUDv2 and KITTI datasets demonstrate the effectiveness of our proposed LMDepth. Compared to previous lightweight depth estimation methods, LMDepth achieves higher performance with fewer parameters and lower computational complexity (measured by GFLOPs). We further deploy LMDepth on an embedded platform with INT8 quantization, validating its practicality for real-world edge applications.

深度估计Mamba轻量模型边缘部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。