arXiv:2605.07326cs.CV2026-05被引 1

用可变形Mamba构建高保真激光雷达世界模型,提升动态环境模拟能力

GEM: Generating LiDAR World Model via Deformable Mamba

论文配图:GEM: Generating LiDAR World Model via Deformable Mamba
图 1 · 摘自论文原文
  • 通过自定义分词器将点云转为紧凑表征,分离动态与静态特征
  • 三路可变形Mamba实现选择性扫描与自适应融合,显著提升时空理解
  • 支持自动驾驶推演和假设场景生成,适合智能驾驶系统研发者

世界模型通过模拟环境动态并生成传感器观测,在自动驾驶领域日益受到关注。然而,基于激光雷达的世界模型进展滞后于基于摄像头视频或占据网格的模型,主要受限于点云固有的无序性以及动态物体与静态结构区分困难。为此,本文提出GEM:一种基于可变形Mamba架构的生成式激光雷达世界模型,显著提升模型保真度与想象力。首先,利用激光扫描序列与Mamba处理机制的结构相似性,设计专用激光雷达场景分词器,将激光雷达扫描数据转换为紧凑表征;随后通过无监督动态-静态分离器解耦特征;再引入三路可变形Mamba,对解耦特征进行选择性扫描与自适应门控融合,增强对世界演化过程的时空理解。此外,可选集成规划器与鸟瞰图布局控制器,探索模型在自主推演及“如果…会怎样”情景生成中的潜力。大量实验表明,GEM在多个基准和评估设置下均达到最先进性能,验证了其优越性与有效性。

原文摘要 · Abstract (English)

World models, which simulate environmental dynamics and generate sensor observations, are gaining increasing attention in autonomous driving. However, progress in LiDAR-based world models has lagged behind those built on camera videos or occupancy data, primarily due to two core challenges: the inherent disorder of LiDAR point clouds and the difficulty of distinguishing dynamic objects from static structures. To address these issues, we propose GEM: a Generative LiDAR world model that leverages deformable mamba architecture, significantly improving fidelity and imaginative capability. Specifically, leveraging the structural similarity between sequential laser scanning and Mamba's processing mechanism, we first tokenize LiDAR sweeps into compact representations via a custom LiDAR scene tokenizer. After unsupervised disentanglement of tokenized features via a dynamic-static separator, a tri-path deformable Mamba is introduced to perform selective scanning and adaptive gating fusion over the disentangled features, leading to enhanced spatial-temporal understanding of the world evolution. Optionally, a planner and a BEV layout controller can be integrated to explore the model's capability for autonomous rollout and its potential to generate ``what-if" scenarios. Extensive experiments show that GEM achieves state-of-the-art performances across diverse benchmarks and evaluation settings, demonstrating its superiority and effectiveness. Project page: https://github.com/wuyang98/GEM.

激光雷达世界模型可变形Mamba自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。