arXiv:2511.21256cs.CV2025-11中稿 · ECCV被引 1

首个可逐帧交互生成长时序激光雷达场景的自回归模型

LaGen: Towards Autoregressive LiDAR Scene Generation

  • 采用自回归框架,单帧输入+框信息条件,逐帧生成4D场景
  • 在nuScenes上生成第10帧时仍保持领先,误差累积显著降低
  • 适合自动驾驶仿真、安全评估等需要长时互动生成的场景

自动驾驶中的生成式世界模型在数据增强、闭环仿真和安全关键场景评估中具有重要价值。与广泛研究的图像模态不同,本文探索激光雷达数据的生成模型。现有激光雷达生成方法多局限于单帧生成或缺乏交互式仿真能力,而现有预测方法需多帧历史输入,且仅能确定性地一次性预测多帧,均无法支持长时交互生成。为此,我们提出LaGen,据我们所知是首个能够以逐帧、交互方式生成长时序激光雷达场景的自回归框架。LaGen以单帧为起点,有效利用边界框信息作为条件,生成高保真4D场景。此外,引入场景解耦估计模块提升对象级内容的交互生成能力,并设计噪声调制模块缓解长时生成中的误差累积。我们在nuScenes数据集上对LaGen进行了充分评估,结果表明其在受控生成和长时序场景生成任务中均达到当前最优性能,尤其在后期帧表现突出。代码已公开:https://github.com/szzhou88/LaGen。

原文摘要 · Abstract (English)

Generative world models for autonomous driving (AD) are of great value in applications such as data augmentation, closed-loop simulation, and safety-critical scenario evaluation. Unlike the widely studied image modality, in this work we explore generative world models for LiDAR data. Existing generation methods for LiDAR predominantly focus on single frame generation or lack the capacity for interactive simulation, while existing prediction approaches require multiple frames of historical input and can only deterministically predict multiple frames at once. Both paradigms fail to support long-horizon interactive generation. To this end, we introduce \textbf{LaGen}, which, to the best of our knowledge is the first autoregressive framework capable of generating long-horizon LiDAR scenes in a frame-by-frame, interactive manner. LaGen is able to take a single-frame input as a starting point and effectively utilize bounding box information as conditions to generate high-fidelity 4D scene. In addition, we introduce a scene decoupling estimation module to enhance the model's interactive generation capability for object-level content, as well as a noise modulation module to mitigate error accumulation during long-horizon generation. We extensively evaluate LaGen's performance in controlled data generation and long-horizon scene generation on the nuScenes dataset. The experimental results demonstrate that LaGen achieves state-of-the-art performance, especially on later frames. The code is publicly available at: https://github.com/szzhou88/LaGen.

激光雷达生成自回归自动驾驶仿真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。