arXiv:2605.05072cs.CV2026-05

通过高度引导重参数化,提升相机激光雷达融合的3D占据预测精度。

Height-Guided Projection Reparameterization for Camera-LiDAR Occupancy

论文配图:Height-Guided Projection Reparameterization for Camera-LiDAR Occupancy
图 1 · 摘自论文原文
  • 基于激光雷达高度图动态调整投影采样范围,实现自适应空间重参数化。
  • 在NuScenes数据集上达到46.8%的mIoU,显著优于现有方法。
  • 适合需要高精度3D场景理解的自动驾驶与机器人感知任务。

3D占据预测旨在从传感器观测中推断密集的体素级场景语义,其中2D到3D视图转换是连接图像特征与体素表示的关键步骤。以往方法多依赖固定投影空间,即沿柱状结构均匀采样3D参考点,但这种采样难以捕捉真实场景的稀疏性与高度变化,导致对应模糊和特征聚合不可靠。为此,我们提出HiPR,一种具有高度引导投影重参数化的相机-激光雷达占据框架。HiPR首先将激光雷达点云编码为俯视图(BEV)高度图,以捕获点云的最大高度;随后利用高度先验调整每根柱的采样范围,实现投影空间的自适应重参数化,使投影点重新分布于几何上有意义的区域而非固定区间。同时,我们对高度图中无效区域进行掩码处理,避免误导特征聚合。此外,为缓解由噪声激光雷达高度引起的训练不稳定性,引入训练阶段渐进高度条件策略,逐步从真值高度过渡到激光雷达高度。大量实验表明,HiPR持续优于现有最先进方法,且保持实时推理速度。代码与预训练模型见https://github.com/yanzq95/HiPR。

原文摘要 · Abstract (English)

3D occupancy prediction aims to infer dense, voxel-wise scene semantics from sensor observations, where the 2D-to-3D view transformation serves as a crucial step in bridging image features and volumetric representations. Most previous methods rely on a fixed projection space, where 3D reference points are uniformly sampled along pillars. However, such sampling struggles to capture the sparsity and height variations of real-world scenes, leading to ambiguous correspondences and unreliable feature aggregation. To address these challenges, we propose HiPR, a camera-LiDAR occupancy framework with Height-Guided Projection Reparameterization. HiPR first encodes LiDAR into a BEV height map to capture the maximum height of the point cloud. HiPR then adjusts the sampling range of each pillar using the height prior, enabling adaptive reparameterization of the projection space. As a result, the projected points are redistributed into geometrically meaningful regions rather than fixed ranges. Meanwhile, we mask out the invalid parts of the height map to avoid misleading the feature aggregation. In addition, to alleviate the training instability caused by noisy LiDAR-derived heights, we introduce a training-time Progressive Height Conditioning strategy, which gradually transitions the conditioning signal from ground-truth heights to LiDAR heights. Extensive experiments demonstrate that HiPR consistently outperforms existing state-of-the-art methods while maintaining real-time inference. The code and pretrained models can be found at https://github.com/yanzq95/HiPR.

3D占据多模态融合自动驾驶深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。