arXiv:2410.02072cs.CV2024-10被引 1

提出轻量级水下深度与法向估计模型,实现低延迟实时感知。

A Practical Approach to Underwater Depth and Surface Normals Estimation

  • 融合CNN与Transformer的混合架构,兼顾精度与效率。
  • 通过伪标签筛选算法提升数据质量,训练成本降低80%。
  • 参数减少90%,适合资源受限的水下机器人部署。

单目深度与表面法向估计(MDSNE)对三维重建、自主导航和水下探索至关重要。现有方法或依赖判别模型(难以处理透明/反光表面),或依赖生成模型(计算开销大)。本文提出一种专为水下环境设计的新型深度学习模型,采用卷积神经网络(CNN)与变换器(Transformers)融合架构,结合二者优势。针对真实数据噪声多、合成数据泛化性差的问题,利用多个预训练MDSNE模型生成伪标签真实数据,并提出深度法向评估与选择算法(DNESA),基于领域特定指标筛选高质量样本。随后在该优化数据集上训练轻量级学生模型。实验表明,模型参数减少90%,训练成本降低80%,可在资源受限设备上实现实时3D感知。主要贡献包括:新型高效MDSNE模型、DNESA算法、领域专用数据流水线及对实时性与可扩展性的关注。本模型面向实际水下应用,助力低成本水下机器人与自主车辆部署,弥合研究与实践的鸿沟。

原文摘要 · Abstract (English)

Monocular Depth and Surface Normals Estimation (MDSNE) is crucial for tasks such as 3D reconstruction, autonomous navigation, and underwater exploration. Current methods rely either on discriminative models, which struggle with transparent or reflective surfaces, or generative models, which, while accurate, are computationally expensive. This paper presents a novel deep learning model for MDSNE, specifically tailored for underwater environments, using a hybrid architecture that integrates Convolutional Neural Networks (CNNs) with Transformers, leveraging the strengths of both approaches. Training effective MDSNE models is often hampered by noisy real-world datasets and the limited generalization of synthetic datasets. To address this, we generate pseudo-labeled real data using multiple pre-trained MDSNE models. To ensure the quality of this data, we propose the Depth Normal Evaluation and Selection Algorithm (DNESA), which evaluates and selects the most reliable pseudo-labeled samples using domain-specific metrics. A lightweight student model is then trained on this curated dataset. Our model reduces parameters by 90% and training costs by 80%, allowing real-time 3D perception on resource-constrained devices. Key contributions include: a novel and efficient MDSNE model, the DNESA algorithm, a domain-specific data pipeline, and a focus on real-time performance and scalability. Designed for real-world underwater applications, our model facilitates low-cost deployments in underwater robots and autonomous vehicles, bridging the gap between research and practical implementation.

深度估计水下视觉轻量化模型实时系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。