arXiv:2506.07350cs.ROcs.CV2025-06

用位编码提升语义地图生成效率,实时补全未知区域

MapBERT: Bitwise Masked Modeling for Real-Time Semantic Mapping Generation

  • 将语义地图转为位级令牌,免查表加速编码
  • 掩码变压器补全未观测区域,重建准确率领先
  • 按物体类别整体遮蔽,增强对空间关系的推理

空间感知是具身智能体的关键能力,使其能预判和推理未观测区域。主要挑战来自室内语义分布的学习,受稀疏、不平衡的物体类别及多样的空间尺度影响。现有方法难以实时稳健生成未观测区域,且在新环境中泛化能力差。为此,我们提出MapBERT,一种有效建模未见空间分布的新框架。受语义地图的一热编码与二进制结构天然契合的启发,首次采用无查表的BitVAE将语义地图编码为紧凑的位级令牌。在此基础上,使用掩码变换器从有限观测中推断缺失区域并生成完整语义地图。为增强以物体为中心的推理,提出物体感知的遮蔽策略,同时遮蔽整个物体类别,并配以可学习嵌入,捕捉物体嵌入与空间令牌间的隐含关系。通过学习这些关系,模型更有效地捕捉对实际机器人任务至关重要的室内语义分布。在Gibson基准测试中,MapBERT实现领先的语义地图生成性能,在计算效率与未观测区域重建准确性之间取得良好平衡。

原文摘要 · Abstract (English)

Spatial awareness is a critical capability for embodied agents, as it enables them to anticipate and reason about unobserved regions. The primary challenge arises from learning the distribution of indoor semantics, complicated by sparse, imbalanced object categories and diverse spatial scales. Existing methods struggle to robustly generate unobserved areas in real time and do not generalize well to new environments. To this end, we propose \textbf{MapBERT}, a novel framework designed to effectively model the distribution of unseen spaces. Motivated by the observation that the one-hot encoding of semantic maps aligns naturally with the binary structure of bit encoding, we, for the first time, leverage a lookup-free BitVAE to encode semantic maps into compact bitwise tokens. Building on this, a masked transformer is employed to infer missing regions and generate complete semantic maps from limited observations. To enhance object-centric reasoning, we propose an object-aware masking strategy that masks entire object categories concurrently and pairs them with learnable embeddings, capturing implicit relationships between object embeddings and spatial tokens. By learning these relationships, the model more effectively captures indoor semantic distributions crucial for practical robotic tasks. Experiments on Gibson benchmarks show that MapBERT achieves state-of-the-art semantic map generation, balancing computational efficiency with accurate reconstruction of unobserved regions.

语义地图位编码机器人感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。