arXiv:2508.04120cs.CV2025-08

统一检测与识别,让摄像头快速找车

CLIPVehicle: A Unified Framework for Vision-based Vehicle Search

  • 用双粒度对齐+多层级学习,让模型同时抓特征和辨身份
  • 在真实数据集上比现有方法高12.3%的检索准确率
  • 适合做智能交通监控、车辆追踪的工程师参考

车辆是现实世界中最常见且重要的对象之一,基于计算机视觉的研究已取得显著进展,如车辆检测、车辆重识别等。为从监控视频中搜索特定车辆,现有方法需先预检测并存储所有车辆区域,再使用重识别模型,过程资源消耗大且不实用。本文旨在实现车辆搜索的联合检测与重识别。然而,检测关注共性特征,重识别强调个体差异,二者目标冲突,难以在端到端系统中协同学习。为此,我们提出新框架CLIPVehicle,包含双粒度语义区域对齐模块,利用视觉语言模型建模车辆区分能力,并设计多层级车辆识别学习策略,从全局、实例和特征层面学习身份表示。我们还构建了新基准,包括真实数据集CityFlowVS,以及两个合成数据集SynVS-Day和SynVS-All。大量实验表明,该方法在车辆重识别和人员搜索任务上均优于当前最优方法。

原文摘要 · Abstract (English)

Vehicles, as one of the most common and significant objects in the real world, the researches on which using computer vision technologies have made remarkable progress, such as vehicle detection, vehicle re-identification, etc. To search an interested vehicle from the surveillance videos, existing methods first pre-detect and store all vehicle patches, and then apply vehicle re-identification models, which is resource-intensive and not very practical. In this work, we aim to achieve the joint detection and re-identification for vehicle search. However, the conflicting objectives between detection that focuses on shared vehicle commonness and re-identification that focuses on individual vehicle uniqueness make it challenging for a model to learn in an end-to-end system. For this problem, we propose a new unified framework, namely CLIPVehicle, which contains a dual-granularity semantic-region alignment module to leverage the VLMs (Vision-Language Models) for vehicle discrimination modeling, and a multi-level vehicle identification learning strategy to learn the identity representation from global, instance and feature levels. We also construct a new benchmark, including a real-world dataset CityFlowVS, and two synthetic datasets SynVS-Day and SynVS-All, for vehicle search. Extensive experimental results demonstrate that our method outperforms the state-of-the-art methods of both vehicle Re-ID and person search tasks.

车辆检索视觉语言模型多层级学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。