用大模型融合多层驾驶特征,提升自动驾驶行为识别准确率
LLM-MLFFN: Multi-Level Autonomous Driving Behavior Feature Fusion via Large Language Model
- 分三层提取数值、行为和动态特征,再结合大模型生成语义描述
- 在Waymo数据集上达到94%以上分类准确率,优于现有方法
- 适合需要可解释性与鲁棒性的自动驾驶安全验证场景
准确分类自动驾驶车辆的驾驶行为对安全验证、性能诊断和交通融合分析至关重要。然而,现有方法主要依赖数值时序建模,缺乏语义抽象,导致在复杂交通环境中可解释性和鲁棒性不足。本文提出LLM-MLFFN,一种基于大语言模型(LLM)增强的多层级特征融合网络,以应对多维驾驶数据的复杂性。该框架包含三个核心组件:(1) 多层级特征提取模块,用于提取统计、行为和动态特征,捕捉驾驶行为的量化特性;(2) 语义描述模块,利用大语言模型将原始数据转化为高层语义特征;(3) 双通道多层级特征融合网络,通过加权注意力机制融合数值与语义特征,提升鲁棒性与预测准确性。在Waymo开放轨迹数据集上的评估表明,所提方法分类准确率超过94%,优于现有机器学习模型。消融实验进一步验证了多层级融合、特征提取策略及大模型语义推理的关键贡献。结果表明,将结构化特征建模与语言驱动的语义抽象结合,为鲁棒的自动驾驶行为分类提供了可解释的路径。
原文摘要 · Abstract (English)
Accurate classification of autonomous vehicle (AV) driving behaviors is critical for safety validation, performance diagnosis, and traffic integration analysis. However, existing approaches primarily rely on numerical time-series modeling and often lack semantic abstraction, limiting interpretability and robustness in complex traffic environments. This paper presents LLM-MLFFN, a novel large language model (LLM)-enhanced multi-level feature fusion network designed to address the complexities of multi-dimensional driving data. The proposed LLM-MLFFN framework integrates priors from largescale pre-trained models and employs a multi-level approach to enhance classification accuracy. LLM-MLFFN comprises three core components: (1) a multi-level feature extraction module that extracts statistical, behavioral, and dynamic features to capture the quantitative aspects of driving behaviors; (2) a semantic description module that leverages LLMs to transform raw data into high-level semantic features; and (3) a dual-channel multi-level feature fusion network that combines numerical and semantic features using weighted attention mechanisms to improve robustness and prediction accuracy. Evaluation on the Waymo open trajectory dataset demonstrates the superior performance of the proposed LLM-MLFFN, achieving a classification accuracy of over 94%, surpassing existing machine learning models. Ablation studies further validate the critical contributions of multi-level fusion, feature extraction strategies, and LLM-derived semantic reasoning. These results suggest that integrating structured feature modeling with language-driven semantic abstraction provides a principled and interpretable pathway for robust autonomous driving behavior classification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。