arXiv:2502.15309cs.RO2025-02被引 12

动态3D高斯场景图实现环境实时更新,提升机器人长期适应能力

DynamicGSG: Dynamic 3D Gaussian Scene Graphs for Environment Adaptation

  • 用高斯点云构建分层语义场景图,融合视觉语言模型理解空间关系
  • 设计联合特征损失优化高斯分组与地图,重建质量显著优于基线方法
  • 支持局部动态更新,在真实实验室中持续适应环境变化,适合长期任务机器人

在真实场景中,人类或智能体活动引发的环境变化使机器人执行长期任务面临巨大挑战。现有方法因无法根据环境变化更新记忆中的场景表示,且缺乏精细重建能力而表现受限。为此,我们提出DynamicGSG——一种基于高斯点渲染的动态、高保真、开放词汇场景图构建系统。该系统利用先进的视觉语言模型构建分层场景图,表征物体间的空间与语义关系;通过自研联合特征损失监督高斯实例分组并优化高斯地图;根据真实环境变化局部更新高斯场景图,实现长期环境适应。实验与消融研究验证了该方法在语义分割、语言引导物体检索及重建质量上的优越性能。进一步在真实实验室环境中验证了系统的动态更新能力。源代码与补充材料将公开于:https://github.com/GeLuzhou/Dynamic-GSG。

原文摘要 · Abstract (English)

In real-world scenarios, environment changes caused by human or agent activities make it extremely challenging for robots to perform various long-term tasks. Recent works typically struggle to effectively understand and adapt to dynamic environments due to the inability to update their environment representations in memory according to environment changes and lack of fine-grained reconstruction of the environments. To address these challenges, we propose DynamicGSG, a dynamic, high-fidelity, open-vocabulary scene graph construction system leveraging Gaussian splatting. DynamicGSG builds hierarchical scene graphs using advanced vision language models to represent the spatial and semantic relationships between objects in the environments, utilizes a joint feature loss we designed to supervise Gaussian instance grouping while optimizing the Gaussian maps, and locally updates the Gaussian scene graphs according to real environment changes for long-term environment adaptation. Experiments and ablation studies demonstrate the performance and efficacy of our proposed method in terms of semantic segmentation, language-guided object retrieval, and reconstruction quality. Furthermore, we validate the dynamic updating capabilities of our system in real laboratory environments. The source code and supplementary experimental materials will be released at:~\href{https://github.com/GeLuzhou/Dynamic-GSG}{https://github.com/GeLuzhou/Dynamic-GSG}.

3D重建动态场景高斯映射机器人感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。