arXiv:2607.22068cs.CVcs.LG2026-07

用预训练模型+重排,单分支比多分支更有效。

Rethinking Multi-Branch and Cross-Backbone Fusion for Vehicle Re-Identification in the Foundation-Model Era

论文配图:Rethinking Multi-Branch and Cross-Backbone Fusion for Vehicle Re-Identification in the Foundation-Model Era
图 1 · 摘自论文原文
  • 用调优的DINOv3-ConvNeXt单分支模型,仅靠视觉特征就达88.19 mAP
  • 多分支融合提升不足1 mAP,且嵌入维度增加4倍但性能未明显改善
  • 跨骨干融合(如Transformer)仍落后13-15 mAP,增益微乎其微

在基础模型时代,我们重新审视多分支架构与CNN-Transformer融合对车辆重识别(Re-ID)的有效性。通过全面实证研究发现,仅使用一个经过调优的DINOv3预训练ConvNeXt模型,即可在VeRi-Wild Small上达到88.19 mAP,VeRi-Wild Large上达77.47 mAP,媲美强基准的多分支方法。采用无训练重排后,性能进一步提升至92.38和83.68 mAP。以该强基线为基础,评估多分支融合效果:在相同骨干网络下,添加多个分支使最佳单分支性能提升不足1 mAP,同时嵌入维度增加4倍,有效秩接近原始维度。进一步采用异构冻结锚点策略融合ConvNeXt与Vision Transformer,尽管条件有利,但Transformer分支仍落后13-15 mAP,配对查询自助法估计最大融合增益仅为+0.11 mAP(95%置信区间)。结果表明,在当前设置下,优化单一强基础模型并结合检索阶段重排,比增加架构复杂度更有效。结论限于单种子训练与一类基础模型,讨论了不适用情形。

原文摘要 · Abstract (English)

Multi-branch architectures and CNN-Transformer fusion have long been regarded as effective ways to improve vehicle re-identification (Re-ID) by combining complementary representations. In this work, we revisit this assumption in the foundation-model era through a comprehensive empirical study. A single DINOv3-pretrained ConvNeXt trained with a tuned recipe achieves 88.19 mAP on VeRi-Wild Small and 77.47 mAP on VeRi-Wild Large using visual cues alone, matching the strongest protocol-verified metadata-dependent multi-branch baseline. Applying training-free re-ranking further improves performance to 92.38 and 83.68 mAP, respectively. Using this strong baseline together with retrieval-level branch diagnostics, we evaluate whether increasing representational diversity still provides measurable gains. Across both benchmarks, concatenating multiple branches built on a shared backbone changes the best single-branch performance by less than one mAP point while increasing the embedding dimension by 4x, and the resulting representation has an effective rank close to the original feature dimension. We further study cross-backbone fusion using an asymmetric frozen-anchor strategy to combine ConvNeXt and Vision Transformer representations. Despite these favorable conditions, Transformer branches consistently remain 13-15 mAP below the ConvNeXt backbone, and paired per-query bootstrap analysis estimates the largest observed fusion gain to be only +0.11 mAP (95% confidence interval). Our results suggest that, under the evaluated setting, improving a single strong foundation-model backbone together with retrieval-stage re-ranking is more effective than increasing architectural complexity through additional branches or heterogeneous backbones. We restrict our conclusions to single-seed training and one family of foundation models and discuss conditions under which these observations may not hold.

车辆重识别基础模型多分支融合特征提取

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。