用增量变化建模3D环境,速度更快精度更高
Delta-Triplane Transformers as Occupancy World Models
- 用三平面表示压缩3D占用信息,减少冗余
- 预测未来变化而非完整状态,提升精度至30.85 IoU
- 适合自动驾驶场景,推理速度达26 FPS
占据世界模型(OWM)通过三维体素化环境表示来预测未来场景,支持智能运动规划。现有方法通常从变分自编码器式潜在编码生成完整的未来占据状态,计算开销大且冗余。本文提出Delta-Triplane Transformers(DTT),一种面向自动驾驶的4D OWM,引入两项关键创新:(1) 基于三平面的表示,比先前方法更紧凑地编码3D占据;(2) 增量预测策略,建模占据的‘变化’而非完整状态。核心思想是:在紧凑的3D潜在空间中,变化更稀疏,更易建模,从而以轻量架构实现更高精度。基于该表示,DTT从历史数据提取多尺度运动特征,并迭代预测未来三平面的增量。这些增量与过去状态结合,解码未来占据和自车轨迹。大量实验表明,DTT相较最先进方法提速1.44倍(达26 FPS),平均交并比提升至30.85,平均绝对规划误差降至1.0米。演示视频见附录。
原文摘要 · Abstract (English)
Occupancy World Models (OWMs) aim to predict future scenes via 3D voxelized representations of the environment to support intelligent motion planning. Existing approaches typically generate full future occupancy states from VAE-style latent encodings, which can be computationally expensive and redundant. We propose Delta-Triplane Transformers (DTT), a novel 4D OWM for autonomous driving, that introduces two key innovations: (1) a triplane based representation that encodes 3D occupancy more compactly than previous approaches, and (2) an incremental prediction strategy for OWM that models {\em changes} in occupancy rather than dealing with full states. The core insight is that changes in the compact 3D latent space are naturally sparser and easier to model, enabling higher accuracy with a lighter-weight architecture. Building on this representation, DTT extracts multi-scale motion features from historical data and iteratively predict future triplane deltas. These deltas are combined with past states to decode future occupancy and ego-motion trajectories. Extensive experiments demonstrate that DTT delivers a 1.44$\times$ speedup (26 FPS) over the state of the art, improves mean IoU to 30.85, and reduces the mean absolute planning error to 1.0 meters. Demo videos are provided in the supplementary material.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。