arXiv:2508.06227cs.CVcs.RO2025-08

提出深度扰动增强法,提升模型在真实深度变化下的泛化能力

Depth Jitter: Seeing through the Depth

  • 基于深度方差阈值动态调整图像深度偏移,保持结构完整
  • 在FathomNet和UTDAC2020上验证,显著提升深度敏感场景稳定性
  • 适合水下成像、自动驾驶等需应对真实深度变化的场景

深度信息在计算机视觉中至关重要,尤其在水下成像、机器人和自主导航领域。然而,传统增强方法忽略深度感知变换,限制了模型对真实世界深度变化的鲁棒性。本文提出Depth-Jitter,一种新型深度增强技术,通过自适应深度偏移模拟自然深度变化,同时保留结构完整性。我们在FathomNet和UTDAC2020两个基准数据集上评估该方法,结果表明其在不同深度条件下均显著提升模型稳定性与泛化能力。对比传统增强如ColorJitter,在多种学习率、编码器和损失函数设置下,尽管绝对性能未始终领先,但深度敏感环境下的表现更稳定。该方法已开源,为深度感知学习研究提供新范式。

原文摘要 · Abstract (English)

Depth information is essential in computer vision, particularly in underwater imaging, robotics, and autonomous navigation. However, conventional augmentation techniques overlook depth aware transformations, limiting model robustness in real world depth variations. In this paper, we introduce Depth-Jitter, a novel depth-based augmentation technique that simulates natural depth variations to improve generalization. Our approach applies adaptive depth offsetting, guided by depth variance thresholds, to generate synthetic depth perturbations while preserving structural integrity. We evaluate Depth-Jitter on two benchmark datasets, FathomNet and UTDAC2020 demonstrating its impact on model stability under diverse depth conditions. Extensive experiments compare Depth-Jitter against traditional augmentation strategies such as ColorJitter, analyzing performance across varying learning rates, encoders, and loss functions. While Depth-Jitter does not always outperform conventional methods in absolute performance, it consistently enhances model stability and generalization in depth-sensitive environments. These findings highlight the potential of depth-aware augmentation for real-world applications and provide a foundation for further research into depth-based learning strategies. The proposed technique is publicly available to support advancements in depth-aware augmentation. The code is publicly available on \href{https://github.com/mim-team/Depth-Jitter}{github}.

深度增强水下成像鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。