提出一种高效自适应模型,实时减少推理延迟并提升域迁移下的预测精度。
Uncertainty-aware Test-Time Training (UT$^3$) for Efficient On-the-fly Domain Adaptive Dense Regression
- 基于不确定性筛选关键帧,仅对高不确定样本进行在线微调。
- 相比传统方法,推理速度提升4.2倍,精度损失小于1.5%。
- 适合资源受限的机器人系统,支持用户自定义更新频率。
深度神经网络在自动驾驶系统中日益普及,但面对域偏移时泛化能力不足。现有测试时训练方法通过自监督对每个测试样本进行多次前向与反向传播以实现在线适应,导致单样本推理时间显著增加,不适用于资源受限且有严格延迟要求的机器人应用。本文提出一种名为UT$^3$的新框架,利用不确定性感知的自监督任务,在保持性能的同时显著降低推理开销。该方法通过量化预测不确定性,仅对高不确定性样本执行微调,从而大幅减少计算量。此外,其连续设置支持用户灵活控制测试时训练的触发频率。我们在单目深度估计这一密集回归任务上验证了该方法的有效性,结果表明在相同精度下,推理速度比标准测试时训练快4.2倍,误差增加低于1.5%。
原文摘要 · Abstract (English)
Deep neural networks (DNNs) are increasingly being used in autonomous systems. However, DNNs do not generalize well to domain shift. Adapting to a continuously evolving environment is a safety-critical challenge inevitably faced by all autonomous systems deployed to the real world. Recent work on test-time training proposes methods that adapt to a new test distribution on the fly by optimizing the DNN model for each test input using self-supervision. However, these techniques result in a sharp increase in inference time as multiple forward and backward passes are required for a single test sample (for test-time training) before finally making the prediction based on the fine-tuned features. This is undesirable for real-world robotics applications where these models may be deployed to resource constraint hardware with strong latency requirements. In this work, we propose a new framework (called UT$^3$) that leverages test-time training for improved performance in the presence of continuous domain shift while also decreasing the inference time, making it suitable for real-world applications. Our method proposes an uncertainty-aware self-supervision task for efficient test-time training that leverages the quantified uncertainty to selectively apply the training leading to sharp improvements in the inference time while performing comparably to standard test-time training protocol. Our proposed protocol offers a continuous setting to identify the selected keyframes, allowing the end-user to control how often to apply test-time training. We demonstrate the efficacy of our method on a dense regression task - monocular depth estimation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。