arXiv:2411.14695cs.CVcs.LG2024-11TPAMI被引 8

提出新框架让行人重识别模型适应新场景不遗忘旧知识。

Anti-Forgetting Adaptation for Unsupervised Person Re-identification

论文配图:Anti-Forgetting Adaptation for Unsupervised Person Re-identification
图 1 · 摘自论文原文
  • 用记忆缓冲区存样本和聚类原型,实现双层次知识保持。
  • 在多个已见和未见场景测试中,模型泛化能力显著提升。
  • 适合需要持续学习新环境的无人监督行人识别应用。

常规无监督域自适应行人重识别(ReID)仅将模型从源域迁移到固定目标域,但适应后难以保留已有知识并泛化到未知数据。本文提出双层联合适应与抗遗忘(DJAA)框架,实现模型对新域的增量式适应,同时避免遗忘源域及已适应目标域的知识。通过在记忆缓冲区中存储少量代表性图像样本及其对应的聚类原型,并在每次适应步骤中更新,利用缓冲区中的图像与原型,正则化图像间相似性和图像-原型相似性,以回放旧知识。经过多步适应后,在所有已见域及若干未见域上进行测试,验证方法的泛化能力。大量实验表明,所提方法显著提升了无监督行人ReID模型的抗遗忘、泛化及向后兼容能力。

原文摘要 · Abstract (English)

Regular unsupervised domain adaptive person re-identification (ReID) focuses on adapting a model from a source domain to a fixed target domain. However, an adapted ReID model can hardly retain previously-acquired knowledge and generalize to unseen data. In this paper, we propose a Dual-level Joint Adaptation and Anti-forgetting (DJAA) framework, which incrementally adapts a model to new domains without forgetting source domain and each adapted target domain. We explore the possibility of using prototype and instance-level consistency to mitigate the forgetting during the adaptation. Specifically, we store a small number of representative image samples and corresponding cluster prototypes in a memory buffer, which is updated at each adaptation step. With the buffered images and prototypes, we regularize the image-to-image similarity and image-to-prototype similarity to rehearse old knowledge. After the multi-step adaptation, the model is tested on all seen domains and several unseen domains to validate the generalization ability of our method. Extensive experiments demonstrate that our proposed method significantly improves the anti-forgetting, generalization and backward-compatible ability of an unsupervised person ReID model.

行人重识别持续学习抗遗忘

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。