新旧关键点增量学习,无需旧数据也能持续提升模型性能。
Incremental Object Keypoint Learning
- 仅标注新数据中的关键点,通过两阶段训练逐步更新模型。
- 新旧关键点关联机制有效缓解遗忘,甚至提升旧关键点精度。
- 适合需要持续学习新目标、标签资源有限的场景。
现有物体关键点估计多依赖预定义关键点的大量标注数据进行监督学习,但训练好的模型难以在测试时识别未定义的新关键点,严重限制了其在下游任务中的应用。为解决此问题,本文提出一种增量关键点学习范式(IKL),仅在新数据中标注新关键点,并在不保留旧数据的前提下逐步训练模型。设计了两阶段学习方案:第一阶段为知识关联(Knowledge Association),利用辅助KA-Net自动根据空间与解剖结构关系将旧关键点关联到新关键点;第二阶段为相互促进(Mutual Promotion),基于关键点导向的空间蒸馏损失,联合使用辅助KA-Net和旧模型实现知识融合,双向提升新旧关键点的估计性能。实验证明,该方法不仅能有效缓解旧关键点遗忘,还可在多数情况下提升其精度,实现正向迁移。在多个关键点数据集上的广泛实验表明,该方法在低样本条件下仍具高效性与优越性。
原文摘要 · Abstract (English)
Existing progress in object keypoint estimation primarily benefits from the conventional supervised learning paradigm based on numerous data labeled with pre-defined keypoints. However, these well-trained models can hardly detect the undefined new keypoints in test time, which largely hinders their feasibility for diverse downstream tasks. To handle this, various solutions are explored but still suffer from either limited generalizability or transferability. Therefore, in this paper, we explore a novel keypoint learning paradigm in that we only annotate new keypoints in the new data and incrementally train the model, without retaining any old data, called Incremental object Keypoint Learning (IKL). A two-stage learning scheme as a novel baseline tailored to IKL is developed. In the first Knowledge Association stage, given the data labeled with only new keypoints, an auxiliary KA-Net is trained to automatically associate the old keypoints to these new ones based on their spatial and intrinsic anatomical relations. In the second Mutual Promotion stage, based on a keypoint-oriented spatial distillation loss, we jointly leverage the auxiliary KA-Net and the old model for knowledge consolidation to mutually promote the estimation of all old and new keypoints. Owing to the investigation of the correlations between new and old keypoints, our proposed method can not just effectively mitigate the catastrophic forgetting of old keypoints, but may even further improve the estimation of the old ones and achieve a positive transfer beyond anti-forgetting. Such an observation has been solidly verified by extensive experiments on different keypoint datasets, where our method exhibits superiority in alleviating the forgetting issue and boosting performance while enjoying labeling efficiency even under the low-shot data regime.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。