用大模型生成驾驶行为描述,让算法更像专家判断。
Driving Style Recognition Like an Expert Using Semantic Privileged Information from Large Language Models
- 用大模型生成驾驶行为自然语言描述,作为语义特权信息
- 在真实场景中提升识别准确率,车道变换任务增7.9%
- 训练时用语义信息,推理只用传感器数据,高效又可解释
现有驾驶风格识别系统主要依赖低层传感器特征训练,忽略了人类专家固有的语义推理能力。这种差异导致算法分类与专家判断存在根本性偏差。为弥合这一差距,我们提出一种新框架,利用大语言模型(LLM)生成的语义特权信息(SPI)使识别结果更贴近人类可理解的推理模式。首先,我们构建DriBehavGPT——一个交互式基于LLM的模块,用于生成驾驶行为的自然语言描述;随后通过文本嵌入与降维将描述转化为机器学习可用表示;最后将这些信息作为特权信息融入SVM+进行训练,使模型逼近人类判别模式。在多种真实驾驶场景下的实验表明,该SPI增强框架优于传统方法,在跟车任务中F1分数提升7.6%,变道任务提升7.9%。重要的是,SPI仅在训练阶段使用,推理阶段仅依赖传感器数据,既保证效率又不损失性能。结果凸显了语义行为表征在提升识别精度及推动可解释、以人为本的驾驶系统中的关键作用。
原文摘要 · Abstract (English)
Existing driving style recognition systems largely depend on low-level sensor-derived features for training, neglecting the rich semantic reasoning capability inherent to human experts. This discrepancy results in a fundamental misalignment between algorithmic classifications and expert judgments. To bridge this gap, we propose a novel framework that integrates Semantic Privileged Information (SPI) derived from large language models (LLMs) to align recognition outcomes with human-interpretable reasoning. First, we introduce DriBehavGPT, an interactive LLM-based module that generates natural-language descriptions of driving behaviors. These descriptions are then encoded into machine learning-compatible representations via text embedding and dimensionality reduction. Finally, we incorporate them as privileged information into Support Vector Machine Plus (SVM+) for training, enabling the model to approximate human-like interpretation patterns. Experiments across diverse real-world driving scenarios demonstrate that our SPI-enhanced framework outperforms conventional methods, achieving F1-score improvements of 7.6% (car-following) and 7.9% (lane-changing). Importantly, SPI is exclusively used during training, while inference relies solely on sensor data, ensuring computational efficiency without sacrificing performance. These results highlight the pivotal role of semantic behavioral representations in improving recognition accuracy while advancing interpretable, human-centric driving systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。