通过异常特征加权实现分层剪枝,让自动驾驶大模型更轻更快
OWLed: Outlier-weighed Layerwise Pruning for Efficient Autonomous Driving Framework
- 按层分配不均匀稀疏度,依据异常特征分布动态压缩模型
- 剪枝后仍保持感知、决策与语言理解能力,计算量显著降低
- 适合需要高效部署大模型的自动驾驶系统研发人员
将大语言模型(LLMs)融入自动驾驶系统可提升环境理解与决策能力,但本地部署带来的巨大算力需求使其难以应用于实际车辆。为此,我们提出OWLed——一种基于异常特征加权的分层剪枝框架,通过非均匀稀疏率压缩模型,无需微调即可大幅减小模型规模。为确保压缩后模型适应自动驾驶任务,我们在校准与剪枝过程中融合驾驶环境数据。实验表明,编码器组件比LLM对剪枝更敏感,凸显其关键作用。结果证明,OWLed在感知、行为预测和语言理解方面优于现有方法,同时显著降低计算开销。该研究验证了先进剪枝技术与大模型结合在构建高效稳健自动驾驶系统中的潜力。代码将公开。
原文摘要 · Abstract (English)
The integration of Large Language Models (LLMs) into autonomous driving systems offers promising enhancements in environmental understanding and decision-making. However, the substantial computational demands of deploying LLMs locally on vehicles render this approach unfeasible for real-world automotive applications. To address this challenge, we introduce OWLed, the Outlier-Weighed Layerwise Pruning for Efficient Autonomous Driving Framework that leverages outlier-weighted layerwise sparsity for model compression. Our method assigns non-uniform sparsity ratios to different layers based on the distribution of outlier features, significantly reducing the model size without the need for fine-tuning. To ensure the compressed model adapts well to autonomous driving tasks, we incorporate driving environment data into both the calibration and pruning processes. Our empirical studies reveal that the encoder component is more sensitive to pruning than the LLM, highlighting its critical role in the system. Experimental results demonstrate that OWLed outperforms existing methods in perception, action prediction, and language understanding while substantially lowering computational requirements. These findings underscore the potential of combining advanced pruning techniques with LLMs to develop efficient and robust autonomous driving systems capable of handling complex scenarios. Code will be made publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。