arXiv:2602.09425cs.CVcs.LG2026-02

不用调参就能用视觉语言模型分类路边激光雷达中的卡车,少样本下表现优异。

Bridging the Modality Gap in Roadside LiDAR: A Training-Free Vision-Language Model Framework for Vehicle Classification

  • 将稀疏点云转为深度图图像,适配现成视觉语言模型
  • 每类仅需16-30个样本,准确率媲美传统监督方法
  • 适合低资源场景,可作冷启动标签生成方案

细粒度卡车分类对智能交通系统至关重要,但现有基于激光雷达的方法依赖监督学习和人工标注,扩展性差。视觉语言模型虽具少样本泛化能力,却受限于点云与图像间的模态差异。本文提出无需参数微调的框架,通过去噪、时空配准、方向校正、形态学操作和各向异性平滑等步骤,将稀疏遮挡的激光雷达扫描转化为深度编码的二维视觉代理。在包含20类车辆的真实数据集上验证,每类仅需16至30个样本即达竞争性分类精度。进一步发现:文本引导在超少样本(k < 4)时有正则化作用,但在多样本情形因语义不匹配导致性能下降。此外,该框架可作为冷启动策略,用VLM生成标签来训练轻量级监督模型。特别地,仅用预训练模型实现特定拖车类别(20英尺、40英尺、53英尺集装箱车)超过75%的正确分类率,无需耗时训练或微调,大幅降低初始标注成本,具备实际应用价值。

原文摘要 · Abstract (English)

Fine-grained truck classification is critical for intelligent transportation systems (ITS), yet current LiDAR-based methods face scalability challenges due to their reliance on supervised deep learning and labor-intensive manual annotation. Vision-Language Models (VLMs) offer promising few-shot generalization, but their application to roadside LiDAR is limited by a modality gap between sparse 3D point clouds and dense 2D imagery. We propose a framework that bridges this gap by adapting off-the-shelf VLMs for fine-grained truck classification without parameter fine-tuning. Our new depth-aware image generation pipeline applies noise removal, spatial and temporal registration, orientation rectification, morphological operations, and anisotropic smoothing to transform sparse, occluded LiDAR scans into depth-encoded 2D visual proxies. Validated on a real-world dataset of 20 vehicle classes, our approach achieves competitive classification accuracy with as few as 16-30 examples per class, offering a scalable alternative to data-intensive supervised baselines. We further observe a "Semantic Anchor" effect: text-based guidance regularizes performance in ultra-low-shot regimes $k < 4$, but degrades accuracy in more-shot settings due to semantic mismatch. Furthermore, we demonstrate the efficacy of this framework as a Cold Start strategy, using VLM-generated labels to bootstrap lightweight supervised models. Notably, the few-shot VLM-based model achieves over correct classification rate of 75 percent for specific drayage categories (20ft, 40ft, and 53ft containers) entirely without the costly training or fine-tuning, significantly reducing the intensive demands of initial manual labeling, thus achieving a method of practical use in ITS applications.

激光雷达少样本学习视觉语言模型交通系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。