arXiv:2507.17640cs.CV2025-07被引 1

大模型预训练权重对人物识别性能有决定性影响,直接微调即可达到顶尖效果。

Not All Starting Points Are Equal: Pre-trained Priors and Their Outsized Impact on Person Identification

  • 用预训练权重作为先验,将域适应看作最大似然估计
  • 在多个数据集上仅微调即达最优,参数变化极小
  • 适合追求高效基准的视觉识别研究者

近年来计算机视觉中出现了多种通用预训练方法,但其对人物识别(re-id)任务的影响仍不明确。我们发现,在相同域适应流程下,不同起始模型(架构与预训练权重)导致的人物识别结果差异显著。现有对性能差异的直观解释均不足,我们提出预训练权重构成强先验,域适应过程可视为以预训练权重为先验的吉布斯后验的最大概率点估计。在此框架下,使用大型预训练基础模型(如CLIP、Dino、EVA、AIM等)配合简单微调,即可在Market、PRCC、DeepChange、BTS等多个re-id数据集上达到当前最优性能,且最终参数与初始参数极为接近。消融实验表明,该效果可通过小规模迁移数据集实现,但对优化器、权重衰减和损失函数敏感。我们主张,直接微调大视觉基础模型应成为未来re-id研究的重要基准。

原文摘要 · Abstract (English)

Recent years have seen an explosion of diverse general purpose pre-training methodologies for computer vision. However, the impact that these pre-training methodologies have on person identification tasks (re-id) remains under-explored. We show that under equated domain adaptation pipelines, there is dramatic variance in person identification outcomes using different starting models (architectures and pre-trained weights). We show that a range of intuitive explanations for differing downstream performance on a range of re-id tests are insufficient and propose that pre-trained weights serve as a strong prior to the weights learned during domain adaptation. This framework allows for domain adapted solutions to be viewed as a maximum probability point estimate of the Gibbs posterior with the pre-trained weights acting as a prior. Under this framework, we show that large, pre-trained foundation models with simple domain adaptation achieve SOTA solutions on a range of re-id datasets (Market, PRCC, DeepChange, BTS) with solutions that are very close in the parameter space to the starting parameters. Moreover, we perform ablations on these solutions and show that they can be reached with small transfer sets and with varying transfer datasets but are sensitive to choice of optimizer, weight-decay, and loss function. Ultimately, we propose that the simple approach of direct fine-tuning using large vision foundation models (CLIP, Dino, EVA, AIM, etc.) needs to serve as an important baseline for future work in re-id.

人物识别预训练微调基础模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。