arXiv:2412.13452cs.CVcs.AI2024-12AAAI被引 2

让相机定位模型持续学习新环境,误差降为原来的1/7

ConDo: Continual Domain Expansion for Absolute Pose Regression

  • 用无标签数据通过知识蒸馏更新已部署的定位模型
  • 在复杂场景中定位误差从14.8米降至1.7米,降幅超7倍
  • 无需重训练,速度比传统方法快25倍,适合长期运行系统

视觉定位是基础机器学习问题。绝对姿态回归(APR)训练一个场景依赖模型,将输入图像高效映射到预定义场景中的相机位姿。然而,许多应用面临持续变化的环境,部署后会出现新的姿态或场景条件(如天气、几何结构)的数据。在固定数据集上训练的APR会过拟合,导致在新数据上灾难性失效。本文提出持续域扩展(ConDo),持续收集无标签推理数据以更新已部署的APR。不同于对APR无效的标准无监督域适应方法,ConDo通过蒸馏场景无关定位方法的知识来有效利用无标签数据。通过均匀采样历史与新数据,ConDo能有效扩展APR的泛化域。构建了涵盖多种场景类型的大规模基准测试,评估模型在实际(长期)数据变化下的表现。ConDo在不同架构、场景类型和数据变化下均显著优于基线。在挑战性场景中,定位误差降低超过7倍(14.8米 vs 1.7米)。分析表明,ConDo对计算预算、回放缓冲区大小和教师预测噪声具有鲁棒性。相比模型重训练,ConDo实现相当性能但快达25倍。

原文摘要 · Abstract (English)

Visual localization is a fundamental machine learning problem. Absolute Pose Regression (APR) trains a scene-dependent model to efficiently map an input image to the camera pose in a pre-defined scene. However, many applications have continually changing environments, where inference data at novel poses or scene conditions (weather, geometry) appear after deployment. Training APR on a fixed dataset leads to overfitting, making it fail catastrophically on challenging novel data. This work proposes Continual Domain Expansion (ConDo), which continually collects unlabeled inference data to update the deployed APR. Instead of applying standard unsupervised domain adaptation methods which are ineffective for APR, ConDo effectively learns from unlabeled data by distilling knowledge from scene-agnostic localization methods. By sampling data uniformly from historical and newly collected data, ConDo can effectively expand the generalization domain of APR. Large-scale benchmarks with various scene types are constructed to evaluate models under practical (long-term) data changes. ConDo consistently and significantly outperforms baselines across architectures, scene types, and data changes. On challenging scenes (Fig.1), it reduces the localization error by >7x (14.8m vs 1.7m). Analysis shows the robustness of ConDo against compute budgets, replay buffer sizes and teacher prediction noise. Comparing to model re-training, ConDo achieves similar performance up to 25x faster.

姿态估计持续学习无监督学习视觉定位

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。