arXiv:2608.29929cs.CV2026-08中稿 · presentation at th…

2D视觉模型在车辆细粒度识别上表现优于3D-aware模型,但后者更抗视角变化。

Evaluating 2D and 3D-Aware Vision Foundation Models for Vehicle Attribute Recognition

  • 用14种2D与3D-aware模型在真实数据集上做线性探测评估
  • 2D模型在车品牌和型号识别上准确率超93%,3D模型在视角变化下更稳定
  • 适合智能交通系统中缺乏车牌识别的场景,推动双模态融合研究

车辆属性识别是智能交通系统中的关键任务,尤其在自动车牌识别(ALPR)不可用或不可靠时。尽管视觉基础模型在跨域迁移中表现强劲,其在细粒度车辆分类中的有效性仍待探索。鉴于车辆具有固有的三维结构,新兴的3D感知基础模型是否优于传统2D架构尚不明确。本文针对14个最先进的2D与3D-aware视觉基础模型进行了实证基准测试。基于具有挑战性的真实世界UFPR-VeSV数据集,我们以冻结特征提取器形式通过线性探测评估车辆类型、品牌和型号识别性能,并进一步在少样本学习和分布外(OOD)域偏移下对最优模型进行压力测试。结果表明,标准2D自监督模型(尤其是DINOv3)在细粒度任务中显著优于3D-aware模型,在品牌与型号识别上实现超过93%的宏观准确率;而3D-aware的Depth Anything v2在车辆类型分类中对视角变化表现出更强的不变性。这些发现为结合2D与3D先验的混合方法提供了动力。代码已公开于https://github.com/UFPR-IPASPPR/3D-Vision-Benchmark/。

原文摘要 · Abstract (English)

Vehicle attribute recognition is an important task in intelligent transportation systems, particularly when Automatic License Plate Recognition (ALPR) is unavailable or unreliable. Although vision foundation models have shown strong transferability across domains, their effectiveness for fine-grained vehicle classification remains underexplored. Moreover, given the inherently three-dimensional structure of vehicles, it is unclear whether emerging 3D-aware foundation models offer advantages over standard 2D architectures. This paper presents an empirical benchmark of 14 state-of-the-art 2D and 3D-aware vision foundation models. Using the challenging real-world UFPR-VeSV dataset, we evaluate these models as frozen feature extractors via linear probing for vehicle type, make, and model recognition. We further stress-test the best-performing models under few-shot learning and Out-of-Distribution (OOD) domain shifts. Our results show that standard 2D self-supervised models, particularly DINOv3, substantially outperform 3D-aware models in fine-grained tasks, achieving over 93% Macro-Accuracy for make and model recognition. However, the 3D-aware Depth Anything v2 exhibits stronger invariance to viewing angles in vehicle type classification. These findings motivate hybrid approaches that combine 2D and 3D priors for robust vehicle recognition. Our code is publicly available at https://github.com/UFPR-IPASPPR/3D-Vision-Benchmark/.

车辆识别视觉模型3D感知少样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。