arXiv:2410.18074cs.CVcs.LG2024-10被引 4

首个无监督持续学习深度补全基准,测试模型在动态数据中的遗忘问题。

UnCLe: Benchmarking Unsupervised Continual Learning for Depth Completion

  • 构建多源异构数据流模拟非平稳分布,评估模型持续学习能力。
  • 实测发现现有方法在新场景下严重遗忘旧知识,遗忘率超40%。
  • 适合研究持续学习、3D重建与自动驾驶感知的学者使用。

我们提出UnCLe,首个针对多模态3D重建任务——深度补全的无监督持续学习标准化基准。深度补全旨在从同步的RGB图像与稀疏深度图中推断稠密深度图。该基准在真实连续数据流场景下评测深度补全模型的无监督持续学习性能。尽管无监督深度学习可实现对随时间变化的数据分布持续学习,但现有方法多在静态数据集上训练。当适应新型非平稳分布时,模型会“灾难性遗忘”先前知识。UnCLe通过使用不同视觉和测距传感器在多样场景中采集的数据序列,模拟非平稳分布,评估模型在室内与室外环境中的表现。我们引入典型持续学习方法并适配至无监督深度补全任务,采用标准定量指标分析灾难性遗忘程度。结果表明,无监督持续学习深度补全是开放性问题,我们邀请研究者使用UnCLe作为开发平台。

原文摘要 · Abstract (English)

We propose UnCLe, the first standardized benchmark for Unsupervised Continual Learning of a multimodal 3D reconstruction task: Depth completion aims to infer a dense depth map from a pair of synchronized RGB image and sparse depth map. We benchmark depth completion models under the practical scenario of unsupervised learning over continuous streams of data. While unsupervised learning of depth boasts the possibility continual learning of novel data distributions over time, existing methods are typically trained on a static, or stationary, dataset. However, when adapting to novel nonstationary distributions, they ``catastrophically forget'' previously learned information. UnCLe simulates these non-stationary distributions by adapting depth completion models to sequences of datasets containing diverse scenes captured from distinct domains using different visual and range sensors. We adopt representative methods from continual learning paradigms and translate them to enable unsupervised continual learning of depth completion. We benchmark these models across indoor and outdoor environments, and investigate the degree of catastrophic forgetting through standard quantitative metrics. We find that unsupervised continual learning of depth completion is an open problem, and we invite researchers to leverage UnCLe as a development platform.

持续学习深度补全3D重建无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。