arXiv:2412.08643cs.CVcs.AI2024-12

一个模型统一生成驾驶场景、轨迹和地图,无需微调即可完成多种任务。

GPD-1: Generative Pre-training for Driving

  • 将驾驶场景建模为统一的标记生成问题,用分层位置编码处理车辆位置与朝向。
  • 在nuPlan数据集上预训练,无需微调即可实现场景生成、交通模拟等六类任务。
  • 适合自动驾驶系统评估与端到端决策研究者使用。

建模驾驶场景的演化对自动驾驶系统的评估与决策至关重要。现有方法多聚焦于场景演化的单一环节,如地图生成、运动预测或轨迹规划。本文提出统一的生成式预训练驾驶模型GPD-1,可一次性完成所有任务而无需额外微调。通过将每个场景表示为本车、其他交通参与者及地图标记,并将自动驾驶建模为统一的标记生成问题。采用自回归Transformer架构,并引入场景级注意力掩码以实现场景内双向交互。针对本车与交通参与者标记,设计分层位置编码以有效表示二维位置与朝向;针对地图标记,训练地图向量量化自编码器,将本车视角的语义地图高效压缩为离散标记。在大规模nuPlan数据集上进行预训练,并开展大量实验验证其有效性。通过不同提示,GPD-1成功泛化至多种任务,包括场景生成、交通模拟、闭环仿真、地图预测与运动规划。代码已开源。

原文摘要 · Abstract (English)

Modeling the evolutions of driving scenarios is important for the evaluation and decision-making of autonomous driving systems. Most existing methods focus on one aspect of scene evolution such as map generation, motion prediction, and trajectory planning. In this paper, we propose a unified Generative Pre-training for Driving (GPD-1) model to accomplish all these tasks altogether without additional fine-tuning. We represent each scene with ego, agent, and map tokens and formulate autonomous driving as a unified token generation problem. We adopt the autoregressive transformer architecture and use a scene-level attention mask to enable intra-scene bi-directional interactions. For the ego and agent tokens, we propose a hierarchical positional tokenizer to effectively encode both 2D positions and headings. For the map tokens, we train a map vector-quantized autoencoder to efficiently compress ego-centric semantic maps into discrete tokens. We pre-train our GPD-1 on the large-scale nuPlan dataset and conduct extensive experiments to evaluate its effectiveness. With different prompts, our GPD-1 successfully generalizes to various tasks without finetuning, including scene generation, traffic simulation, closed-loop simulation, map prediction, and motion planning. Code: https://github.com/wzzheng/GPD.

自动驾驶生成模型预训练场景生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。