GenAI赋能自动驾驶,生成数据与决策新范式。
Generative AI for Autonomous Driving: Frontiers and Opportunities
- 用生成模型合成驾驶数据、轨迹与场景,替代真实采集。
- 推动端到端驾驶与数字孪生系统发展,提升泛化能力。
- 适合研究自动驾驶与生成模型融合的学者与工程师。
生成式人工智能(GenAI)正重塑产业,其在内容生成、推理规划和多模态理解方面的能力为实现可靠全自动驾驶(尤其是L5级)提供了最有望的路径。本文综述了GenAI在自动驾驶技术栈中的前沿应用,涵盖变分自编码器(VAEs)、生成对抗网络(GANs)、扩散模型及大语言模型(LLMs)的原理与权衡。重点分析其在图像、激光雷达、轨迹、占据网格、视频生成以及LLM驱动的推理与决策中的应用。系统分类了合成数据流程、端到端驾驶策略、高保真数字孪生系统、智能交通网络和具身智能跨域迁移等实用场景。指出全面泛化于罕见场景、评估与安全验证、资源受限部署、合规性、伦理与环境影响等挑战,并提出理论保障、可信度度量、交通集成与社会技术影响的研究方向。该综述为研究人员、工程师与政策制定者提供了前瞻参考。相关文献库持续更新:https://github.com/taco-group/GenAI4AD。
原文摘要 · Abstract (English)
Generative Artificial Intelligence (GenAI) constitutes a transformative technological wave that reconfigures industries through its unparalleled capabilities for content creation, reasoning, planning, and multimodal understanding. This revolutionary force offers the most promising path yet toward solving one of engineering's grandest challenges: achieving reliable, fully autonomous driving, particularly the pursuit of Level 5 autonomy. This survey delivers a comprehensive and critical synthesis of the emerging role of GenAI across the autonomous driving stack. We begin by distilling the principles and trade-offs of modern generative modeling, encompassing VAEs, GANs, Diffusion Models, and Large Language Models (LLMs). We then map their frontier applications in image, LiDAR, trajectory, occupancy, video generation as well as LLM-guided reasoning and decision making. We categorize practical applications, such as synthetic data workflows, end-to-end driving strategies, high-fidelity digital twin systems, smart transportation networks, and cross-domain transfer to embodied AI. We identify key obstacles and possibilities such as comprehensive generalization across rare cases, evaluation and safety checks, budget-limited implementation, regulatory compliance, ethical concerns, and environmental effects, while proposing research plans across theoretical assurances, trust metrics, transport integration, and socio-technical influence. By unifying these threads, the survey provides a forward-looking reference for researchers, engineers, and policymakers navigating the convergence of generative AI and advanced autonomous mobility. An actively maintained repository of cited works is available at https://github.com/taco-group/GenAI4AD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。