用视觉几何证据构建可长期记忆的语义占位地图,提升智能体在室内环境中的空间理解能力。
GEM-Occ: From Visual Geometry Evidence to Embodied Semantic Occupancy Memory

- 将视觉几何信息转为高斯证据,分层融合成持久化语义占位记忆
- 在跨房间场景中实现更稳定的自由空间推理与重访一致性
- 适用于长期导航与多场景建图的机器人系统
语义占位通过联合表示占据区域、观测到的空域、未知区域及物体语义,为具身室内智能体提供结构化空间记忆。然而现有室内占位基准和方法主要聚焦单视角预测或房间级在线感知,缺乏对连通室内空间中长时程语义映射的研究。我们提出 HIOcc,一个统一 ScanNet、ScanNet++ 与 Matterport3D 的分层室内占位基准,采用共同稀疏语义占位格式并保留其原始观测几何(包括透视 RGB-D 帧与全景中心观测组)。HIOcc 支持三种互补评估范式:局部语义占位预测、房间级在线占位映射,以及跨全景环境的建筑级映射。我们进一步提出 GEM-Occ,一种基于高斯证据记忆的语义占位映射框架。不同于使用点云作为持久地图状态,GEM-Occ 将局部视觉几何预测视为瞬态证据,转化为语义高斯占位证据与自由空间射线证据,并通过可见性与不确定性感知的因果更新机制,将其融合进分层持久记忆中。该记忆按本地缓存、房间级子图、建筑级图结构组织,可通过高斯到占位的投射随时查询。在 HIOcc 上的实验表明,GEM-Occ 在局部占位预测、在线地图稳定性、自由空间推理、重访一致性及建筑级可扩展性方面均优于先前的室内占位与基于高斯的地图基线方法。
原文摘要 · Abstract (English)
Semantic occupancy provides a structured spatial memory for embodied indoor agents by jointly representing occupied regions, observed free space, unknown areas, and object semantics. However, existing indoor occupancy benchmarks and methods mainly focus on single-view prediction or room-level online perception, leaving long-horizon semantic mapping across connected indoor spaces underexplored. We introduce HIOcc, a hierarchical indoor occupancy benchmark that unifies ScanNet, ScanNet++, and Matterport3D under a common sparse semantic occupancy format while preserving their native observation geometries, including perspective RGB-D frames and pano-centric observation groups. HIOcc supports three complementary evaluation regimes: local semantic occupancy prediction, room-level online occupancy mapping, and building-level mapping across connected panoramic environments. We further propose GEM-Occ, a Gaussian Evidence Memory framework for semantic occupancy mapping. Rather than using pointmaps as persistent map states, GEM-Occ treats local visual geometry predictions as transient evidence, converts them into semantic Gaussian occupancy evidence and free-space ray evidence, and fuses them into a persistent hierarchical memory through visibility- and uncertainty-aware causal updates. The memory is organized into local caches, room-level submaps, and a building-level graph, and can be queried at any time through Gaussian-to-occupancy splatting. Experiments on HIOcc show that GEM-Occ improves local occupancy prediction, online map stability, free-space reasoning, revisit consistency, and building-level scalability over prior indoor occupancy and Gaussian-based mapping baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。