arXiv:2412.18381cs.RO2024-12被引 21

用3D场景图压缩多机器人地图传输量,省超80%数据仍保持精准查询。

MR-COGraphs: Communication-efficient Multi-Robot Open-vocabulary Mapping System via 3D Scene Graphs

  • 构建带语义的3D场景图,节点表物体,边表空间关系。
  • 传输前压缩特征,接收后解码恢复,数据量减少超80%。
  • 适合通信受限的多机器人协同导航与开放词汇查询场景。

多机器人在未知环境中的协同感知至关重要。随着基础模型的发展,机器人不仅能感知几何信息,还能实现开放词汇的场景理解。然而,现有支持开放词汇查询的地图表示通常数据量大,在通信受限环境下成为瓶颈。为此,我们提出一种图结构3D表示方法COGraph,其中节点代表具有语义特征的物体,边表示其空间邻接关系。传输前,通过数据驱动的特征编码器压缩COGraph的特征维度;接收后,利用解码器恢复各节点的语义特征。我们还提出基于特征的位姿识别与位移估计方法,实现局部COGraph的融合生成统一全局地图。在两个真实数据集和真实环境中的验证表明,相比现有开放词汇地图构建基线,本框架将数据量减少超过80%,同时保持映射与查询性能无损。

原文摘要 · Abstract (English)

Collaborative perception in unknown environments is crucial for multi-robot systems. With the emergence of foundation models, robots can now not only perceive geometric information but also achieve open-vocabulary scene understanding. However, existing map representations that support open-vocabulary queries often involve large data volumes, which becomes a bottleneck for multi-robot transmission in communication-limited environments. To address this challenge, we develop a method to construct a graph-structured 3D representation called COGraph, where nodes represent objects with semantic features and edges capture their spatial adjacency relationships. Before transmission, a data-driven feature encoder is applied to compress the feature dimensions of the COGraph. Upon receiving COGraphs from other robots, the semantic features of each node are recovered using a decoder. We also propose a feature-based approach for place recognition and translation estimation, enabling the merging of local COGraphs into a unified global map. We validate our framework on two realistic datasets and the real-world environment. The results demonstrate that, compared to existing baselines for open-vocabulary map construction, our framework reduces the data volume by over 80\% while maintaining mapping and query performance without compromise. For more details, please visit our website at https://github.com/efc-robot/MR-COGraphs.

多机器人3D地图开放词汇通信效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。