解决3D域适应训练中性能下降问题,让模型更稳定可靠。
Train Till You Drop: Towards Stable and Robust Source-free Unsupervised 3D Domain Adaptation
- 通过正则化和参考模型一致性判断,约束无监督训练过程。
- 在多个3D激光雷达数据集上实现当前最优性能,提升稳定性和鲁棒性。
- 无需目标域标签,可自动停止训练并调参,适合实际部署场景。
本文研究3D语义分割中的源域无关无监督域自适应(SFUDA)问题,即在无法访问源域数据的情况下,仅依靠源域上训练好的模型,在未标注的目标域上进行域自适应。现有方法常因问题欠约束而出现训练后期性能下降。本文提出两种策略:一是合理正则化学习过程;二是引入基于与参考模型一致性的新准则,用于适时停止训练,并在无目标域知识条件下选择超参数。该方法易于实现,适用于各类SFUDA方法,显著提升稳定性与性能。在多个3D激光雷达设置下验证,达到当前最优表现。代码已开源:github.com/valeoai/TTYD。
原文摘要 · Abstract (English)
We tackle the challenging problem of source-free unsupervised domain adaptation (SFUDA) for 3D semantic segmentation. It amounts to performing domain adaptation on an unlabeled target domain without any access to source data; the available information is a model trained to achieve good performance on the source domain. A common issue with existing SFUDA approaches is that performance degrades after some training time, which is a by product of an under-constrained and ill-posed problem. We discuss two strategies to alleviate this issue. First, we propose a sensible way to regularize the learning problem. Second, we introduce a novel criterion based on agreement with a reference model. It is used (1) to stop the training when appropriate and (2) as validator to select hyperparameters without any knowledge on the target domain. Our contributions are easy to implement and readily amenable for all SFUDA methods, ensuring stable improvements over all baselines. We validate our findings on various 3D lidar settings, achieving state-of-the-art performance. The project repository (with code) is: github.com/valeoai/TTYD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。