提出灵活可扩展的自监督单目深度模型,提升复杂驾驶场景下的感知鲁棒性。
Towards Robust Driving Perception: A Flexible Scale-Driven Family for Self-Supervised Monocular Depth Estimation

- 采用动静分离双阶段训练,独立评估静态背景与动态物体的置信度
- 通过可变尺度解码器动态融合特征,实现任意尺度下高精度深度图输出
- 最小模型仅0.7 GFLOPs,移动端达37.6 FPS,适合边缘设备实时部署
自监督单目深度估计因无需真实标签而受到关注,但现有模型多局限于单一尺度,在复杂驾驶环境中性能显著下降。针对动态交通参与者设计的网络通常过于复杂,难以在资源受限的车载边缘设备上部署。为此,我们提出FlexDepth——一个面向复杂道路场景的尺度驱动型自监督单目深度估计模型家族。该模型采用两阶段静态-动态解耦训练策略,可分别评估静态背景与动态物体的置信度;同时引入精心设计的尺度驱动解码器(SDD),根据尺度大小动态选择组件,实现高效特征融合与高精度深度图生成。在标准驾驶基准上的大量实验表明,无需额外信息即可在任意尺度上达到领先性能,计算开销极小。最小模型Flex-Nano仅需0.7 GFLOPs,移动端可达37.6 FPS,保证实时可靠感知并具备优异零样本泛化能力。
原文摘要 · Abstract (English)
Self-Supervised Monocular Depth Estimation (MDE) has garnered attention in recent years due to its independence from ground truth. However, most existing models are limited to a single scale and exhibit considerable performance degradation in complex driving environments. Networks specifically designed to handle dynamic traffic participants tend to be overly complex, hindering their deployment on resource-constrained automotive edge devices. To address these limitations and move towards robust driving perception, we propose FlexDepth, a scale-driven and flexible family of self-supervised MDE models tailored for challenging road scenarios. FlexDepth employs a two-stage static-dynamic decoupled training strategy, enabling the independent assessment of confidence for both static backgrounds and dynamic road objects. Furthermore, it introduces a meticulously designed Scale-Driven Decoder (SDD) to dynamically select components based on scale size, facilitating efficient feature fusion and the output of high-precision depth maps. Extensive experiments on standard driving benchmarks demonstrate that without any auxiliary information, our model achieves state-of-the-art performance across arbitrary scales with minimal computational overhead. Our smallest model, Flex-Nano, requires only 0.7 GFLOPs and achieves 37.6 FPS on mobile platforms, ensuring reliable real-time perception while maintaining excellent zero-shot generalization. Our source code is avalible: https://github.com/startnew/flexdepth
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。