用文本提示稳定视觉模型,实现持续学习中的人体再识别
Prompt-Anchored Vision-Text Distillation for Lifelong Person Re-identification

- 用预训练文本编码器做跨域语义锚点,保持语义一致性
- 视觉侧通过自适应提示池实现增量学习,冻结旧信息不遗忘
- 在新旧场景下均表现更优,适合持续更新数据的识别系统
持续人体再识别(LReID)旨在用顺序收集的数据训练通用模型。然而,随着新域出现,现有模型常面临语义漂移、适应性差和灾难性遗忘问题。现有无示例方法多依赖纯视觉蒸馏或参数正则化,忽视了文本等辅助模态在维持语义稳定性和支持增量可塑性方面的潜力。我们观察到,预训练视觉-语言模型中的冻结文本编码器可在跨域间提供稳定的语义锚点。为此,提出不对称的视觉-文本蒸馏框架PAD:在文本侧,蒸馏提示以在固定语义空间中保持视觉-文本对齐,作为全局参考而非主导信号;在视觉侧,采用基于EMA的教师模型与自适应提示池,动态分配新槽位同时冻结旧信息。大量实验表明,PAD在已见与未见域上显著优于当前最优方法,实现了稳定性与可塑性的良好平衡。
原文摘要 · Abstract (English)
Lifelong person re-identification (LReID) aims to train a generalizable model with sequentially collected data. However, such models often suffer from semantic drift, limited adaptability, and catastrophic forgetting as new domains emerge. Existing exemplar-free approaches largely rely on visual-only distillation or parameter regularization, while overlooking the potential of auxiliary modalities, such as text, to preserve semantic stability and enable incremental plasticity. We observe that the frozen text encoder in pretrained vision-language models can serve as a stable semantic anchor across domains. To decouple the roles of vision and text, we propose Prompt-Anchored vision-text Distillation (PAD), an asymmetric vision-text framework for semantic alignment and cross-domain generalization. On the textual side, we distill prompts to preserve vision-text alignment under a fixed semantic space, acting as a global semantic reference rather than a dominant learning signal. On the visual side, an EMA-based teacher with an adaptive prompt pool enables domain-wise adaptation by allocating new slots while freezing past ones. Extensive experiments show that PAD substantially outperforms state-of-the-art methods across seen and unseen domains, achieving a strong balance between stability and plasticity. Project page is available at https://github.com/zu-zi/PAD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。