轻量级单目深度估计模型,适合嵌入式设备部署
XiDepth: a Lightweight and Efficient Network for Self-supervised Monocular Depth Estimation

- 基于XiNet模块设计轻量网络,提升特征提取效率
- 仅0.8M参数,在KITTI上达顶尖性能
- 在树莓派上降低40%计算量和35%能耗
自监督单目深度估计因其对昂贵深度传感器依赖度低,成为资源受限设备上轻量高效模型的优选方案。该方法无需真实深度标注,利用单目相机结构简化数据采集,适用于计算机视觉与机器人等多个领域。核心挑战在于如何在不牺牲性能的前提下实现资源高效。现有先进模型多采用深度可分离卷积和注意力机制,但常导致高能耗且难以适配嵌入式环境。为此,本文提出XiDepth,一种基于XiNet算子块的轻量架构,在保证低计算复杂度和低能耗的同时增强特征提取能力。在KITTI数据集上,其参数量仅为0.8M,性能达到当前最优水平。在树莓派4上的测试进一步验证其实际适用性:相比主流方法,计算量减少40%,能耗降低35%。
原文摘要 · Abstract (English)
Self-supervised monocular depth estimation has emerged as an appealing solution to design lightweight and effective models for deployment on computationally constrained devices due to its reduced reliance on expensive depth sensors. By eliminating the need for ground-truth annotations and leveraging the simplicity of monocular camera setups, this approach facilitates cost-effective data collection and broad applicability across fields such as computer vision and robotics. A critical challenge is achieving resource-efficient neural networks without compromising the overall performance. State-of-the-art models generally adopt depth-wise convolutions and attention mechanisms; however, these functions often incur high energy costs and face compatibility issues in embedded environments. To address this, we propose XiDepth, a lightweight architecture based on the XiNet operator block, designed to enhance feature extraction while maintaining low computational complexity and energy demand. On the KITTI dataset, XiDepth achieves state-of-the-art performance with only 0.8M parameters. Tests on a Raspberry Pi 4 further confirm its suitability for real-world embedded applications, reducing FLOPs by 40% and energy consumption by 35% compared to leading methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。