提出SCAT框架,解决自监督单目深度估计中的对抗训练不稳问题。
Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Training
- 设计可缩放深度网络,稳定跳连结构提升训练鲁棒性
- 引入冲突梯度手术策略,缓解过正则化导致的性能下降
- 在5个基准上实现最佳泛化性能,适合追求鲁棒性的研究者
自监督单目深度估计(MDE)模型的域泛化能力仍面临巨大挑战。尽管对抗增强在监督学习中表现良好,但直接应用于自监督MDE模型可能导致过正则化,引发严重性能退化。本文通过定性分析揭示两大原因:(i) UNet类深度网络固有的敏感性;(ii) 过正则化引起的双重优化冲突。为此,提出通用对抗训练框架SCAT,将对抗数据增强融入自监督MDE方法,实现稳定与泛化间的平衡。具体而言,设计一种有效缩放深度网络,调节长跳连系数以稳定训练过程;并提出冲突梯度手术策略,逐步融合对抗梯度,引导模型朝无冲突方向优化。在五个基准上的大量实验表明,SCAT可达到当前最优性能,显著提升现有自监督MDE方法的泛化能力。
原文摘要 · Abstract (English)
Learning a self-supervised Monocular Depth Estimation (MDE) model with great generalization remains significantly challenging. Despite the success of adversarial augmentation in the supervised learning generalization, naively incorporating it into self-supervised MDE models potentially causes over-regularization, suffering from severe performance degradation. In this paper, we conduct qualitative analysis and illuminate the main causes: (i) inherent sensitivity in the UNet-alike depth network and (ii) dual optimization conflict caused by over-regularization. To tackle these issues, we propose a general adversarial training framework, named Stabilized Conflict-optimization Adversarial Training (SCAT), integrating adversarial data augmentation into self-supervised MDE methods to achieve a balance between stability and generalization. Specifically, we devise an effective scaling depth network that tunes the coefficients of long skip connection and effectively stabilizes the training process. Then, we propose a conflict gradient surgery strategy, which progressively integrates the adversarial gradient and optimizes the model toward a conflict-free direction. Extensive experiments on five benchmarks demonstrate that SCAT can achieve state-of-the-art performance and significantly improve the generalization capability of existing self-supervised MDE methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。