arXiv:2503.20654cs.CVcs.AI2025-03被引 1

用事故报告生成真实物理碰撞的车辆视频,解决自动驾驶训练数据难题

AccidentSim: Generating Vehicle Collision Videos with Physically Realistic Collision Trajectories from Real-World Accident Reports

  • 从事故报告提取物理信息,用物理模拟器生成真实碰撞轨迹
  • 构建轨迹数据集并微调语言模型,实现用户描述驱动的轨迹预测
  • 结合NeRF渲染背景,生成视觉与物理双重真实的碰撞视频

自动驾驶研究中的真实车辆事故视频因稀有性和复杂性难以获取。现有驾驶视频生成方法虽能呈现视觉真实感,却常因无法生成准确的碰撞后轨迹而缺乏物理真实性。本文提出AccidentSim,一种新框架,通过解析真实事故报告中的物理线索与上下文信息,利用可靠物理模拟器复现碰撞后车辆轨迹,并构建车辆碰撞轨迹数据集。该数据集用于微调语言模型,使其可根据用户描述预测多种驾驶场景下的物理一致碰撞轨迹。最后,采用神经辐射场(NeRF)渲染高质量背景,与具备真实轨迹的前景车辆融合,生成车辆碰撞视频。实验表明,AccidentSim生成的视频在视觉与物理真实性上均表现优异。

原文摘要 · Abstract (English)

Collecting real-world vehicle accident videos for autonomous driving research is challenging due to their rarity and complexity. While existing driving video generation methods may produce visually realistic videos, they often fail to deliver physically realistic simulations because they lack the capability to generate accurate post-collision trajectories. In this paper, we introduce AccidentSim, a novel framework that generates physically realistic vehicle collision videos by extracting and utilizing the physical clues and contextual information available in real-world vehicle accident reports. Specifically, AccidentSim leverages a reliable physical simulator to replicate post-collision vehicle trajectories from the physical and contextual information in the accident reports and to build a vehicle collision trajectory dataset. This dataset is then used to fine-tune a language model, enabling it to respond to user prompts and predict physically consistent post-collision trajectories across various driving scenarios based on user descriptions. Finally, we employ Neural Radiance Fields (NeRF) to render high-quality backgrounds, merging them with the foreground vehicles that exhibit physically realistic trajectories to generate vehicle collision videos. Experimental results demonstrate that the videos produced by AccidentSim excel in both visual and physical authenticity.

事故生成物理模拟视频合成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。