用体素中心框架实现高效实时场景占位预测,无需预设尺度。
VEOcc: Voxel-Centric Online Semantic Occupancy Prediction For Embodied Scene Understanding

- 基于体素的递归感知与融合机制,无需初始尺度估计。
- 在Occ-ScanNet和EmbodiedOcc-ScanNet上达到新最优性能。
- 支持零样本泛化,适用于未知真实环境中的自主探索。
对于自主探索至关重要,在线3D占位预测与建图能实时构建密集空间表征。然而,现有高斯中心方法在结构边界保真度上表现不佳,且严重依赖预设场景尺寸先验,从根本上限制了运行效率。本文提出VEOcc,一种体素中心框架,采用递归感知-融合范式。通过消除初始尺度估计需求,实现高度简化的开放地图扩展。为在离散体素空间中稳健聚合噪声时间观测,我们提出时空感知在线更新策略:结合跨时序对数融合(TLA)以保证时间一致性,可靠性感知置信度调制(RCM)校准空间不确定性,以及置信度驱动的增量状态更新(CSU)实现鲁棒全局状态融合。在Occ-ScanNet和EmbodiedOcc-ScanNet上的大量实验表明,VEOcc在局部与具身设置下均达到新最佳性能。值得注意的是,对自采集视频序列的零样本评估进一步证实其在完全未见真实环境中的强泛化能力。最终,本框架提供了一种准确且高效的自主探索解决方案。代码与补充可视化见项目页:https://wryzju.github.io/VEOcc/
原文摘要 · Abstract (English)
Crucial for autonomous exploration, online 3D occupancy prediction and mapping incrementally constructs dense spatial representations on the fly. However, recent Gaussian-centric methods struggle with structural boundary fidelity and rely heavily on predefined scene-size priors, fundamentally limiting their operational efficiency. In this work, we present VEOcc, a voxel-centric framework formulated as a recursive perception-and-assimilation paradigm. By eliminating the need for initial scale estimation, VEOcc enables highly streamlined, open-ended map expansion. Furthermore, to robustly aggregate noisy temporal observations within the discrete voxel space, we propose a Spatio-Temporal-Aware Online Update Strategy. It integrates Cross-Temporal Logit Aggregation (TLA) for temporal consistency, Reliability-Aware Confidence Modulation (RCM) for spatial uncertainty calibration, and Confidence-Driven Incremental State Update (CSU) for robust global state assimilation. % Extensive experiments on Occ-ScanNet and EmbodiedOcc-ScanNet demonstrate that VEOcc establishes new state-of-the-art performance in both local and embodied settings, providing an accurate and efficient solution for real-world exploration. Extensive experiments on Occ-ScanNet and EmbodiedOcc-ScanNet demonstrate that VEOcc establishes new state-of-the-art performance in both local and embodied settings. Notably, zero-shot evaluations on self-collected video sequences further confirm its robust out-of-distribution generalization capability in completely unseen real-world environments. Ultimately, our framework provides an accurate and highly efficient solution for autonomous exploration. Code and supplementary visualizations are available on our project page: https://wryzju.github.io/VEOcc/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。