arXiv:2604.05271cs.CV2026-04中稿 · publication in the…被引 6

构建首个融合车体细粒度分类与车牌识别的公开数据集,推动智能交通系统落地。

Toward Unified Fine-Grained Vehicle Classification and Automatic License Plate Recognition

  • 构建多属性标注的细粒度车辆数据集,支持真实场景下复杂条件分析。
  • 在24,945张图像中验证13种颜色、26个品牌、136款车型等属性识别挑战。
  • 首次实现细粒度分类与车牌识别联合建模,适用于公安、交通管理场景。

从监控图像中提取车辆信息对智能交通系统至关重要,支持交通监控与刑侦调查。尽管自动车牌识别(ALPR)广泛应用,细粒度车辆分类(FGVC)通过颜色、品牌、型号、类型等属性提供互补信息。现有研究多依赖理想条件、属性有限且忽视与ALPR的整合。为此,我们提出UFPR-VeSV数据集,包含24,945张图像、16,297辆唯一车辆,涵盖13种颜色、26个品牌、136款车型和14种车型类型标注。数据源自巴西巴拉那州军事警察监控系统,覆盖部分遮挡、夜间红外成像及光照变化等真实复杂场景。所有FGVC标注均通过车牌信息验证,并提供文本与角点标注。与现有数据集的定性与定量对比证实其挑战性。五种深度学习模型的基准测试揭示了处理多色车辆、红外图像及共享平台车型区分等难点。此外,采用两种OCR模型进行车牌识别,并探索FGVC与ALPR联合应用。结果表明两者融合具有实际应用潜力。该数据集已开源:https://github.com/Lima001/UFPR-VeSV-Dataset。

原文摘要 · Abstract (English)

Extracting vehicle information from surveillance images is essential for intelligent transportation systems, enabling applications such as traffic monitoring and criminal investigations. While Automatic License Plate Recognition (ALPR) is widely used, Fine-Grained Vehicle Classification (FGVC) offers a complementary approach by identifying vehicles based on attributes such as color, make, model, and type. Although there have been advances in this field, existing studies often assume well-controlled conditions, explore limited attributes, and overlook FGVC integration with ALPR. To address these gaps, we introduce UFPR-VeSV, a dataset comprising 24,945 images of 16,297 unique vehicles with annotations for 13 colors, 26 makes, 136 models, and 14 types. Collected from the Military Police of Paraná (Brazil) surveillance system, the dataset captures diverse real-world conditions, including partial occlusions, nighttime infrared imaging, and varying lighting. All FGVC annotations were validated using license plate information, with text and corner annotations also being provided. A qualitative and quantitative comparison with established datasets confirmed the challenging nature of our dataset. A benchmark using five deep learning models further validated this, revealing specific challenges such as handling multicolored vehicles, infrared images, and distinguishing between vehicle models that share a common platform. Additionally, we apply two optical character recognition models to license plate recognition and explore the joint use of FGVC and ALPR. The results highlight the potential of integrating these complementary tasks for real-world applications. The UFPR-VeSV dataset is publicly available at: https://github.com/Lima001/UFPR-VeSV-Dataset.

车辆识别细粒度分类车牌识别数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。