arXiv:2508.08624cs.ROcs.IT2025-08被引 6

用高斯点云优化机器人虚实融合,大幅降低通信开销。

Communication Efficient Robotic Mixed Reality with Gaussian Splatting Cross-Layer Optimization

  • 通过高斯点云记忆实现机器人视角的逼真渲染,减少图像上传
  • 跨层优化框架降低通信成本超10倍,支持动态环境适应
  • 适用于轮式与足式机器人,适合低带宽实时虚实系统

在机器人混合现实(RoboMR)系统中,无线信道上传高分辨率图像带来高昂通信成本。本文提出基于高斯点云(GS)的RoboMR(GSMR)方法,通过调用GS模型中的“记忆”生成机器人视角的逼真视图,显著减少图像上传需求。然而,GS模型与真实环境存在差异。为此,提出跨层优化框架GSCLO,联合优化帧级内容切换(是否上传图像)与功率分配,以最小化新提出的GSMR损失函数。采用加速惩罚优化(APO)算法,计算复杂度较传统分支定界与搜索算法降低超过10倍。进一步设计了鲁棒、低功耗及多机器人版本的GSCLO。大量实验表明,所提GSMR范式与GSCLO方法在轮式和足式机器人上均显著优于现有基准,在多种场景下实现多项指标提升。首次发现,可实现超低通信成本的RoboMR;动态场景中数据混合有助于提升GS性能。

原文摘要 · Abstract (English)

Realizing low-cost communication in robotic mixed reality (RoboMR) systems presents a challenge, due to the necessity of uploading high-resolution images through wireless channels. This paper proposes Gaussian splatting (GS) RoboMR (GSMR), which enables the simulator to opportunistically render a photo-realistic view from the robot's pose by calling ``memory'' from a GS model, thus reducing the need for excessive image uploads. However, the GS model may involve discrepancies compared to the actual environments. To this end, a GS cross-layer optimization (GSCLO) framework is further proposed, which jointly optimizes content switching (i.e., deciding whether to upload image or not) and power allocation (i.e., adjusting to content profiles) across different frames by minimizing a newly derived GSMR loss function. The GSCLO problem is addressed by an accelerated penalty optimization (APO) algorithm that reduces computational complexity by over $10$x compared to traditional branch-and-bound and search algorithms. Moreover, variants of GSCLO are presented to achieve robust, low-power, and multi-robot GSMR. Extensive experiments demonstrate that the proposed GSMR paradigm and GSCLO method achieve significant improvements over existing benchmarks on both wheeled and legged robots in terms of diverse metrics in various scenarios. For the first time, it is found that RoboMR can be achieved with ultra-low communication costs, and mixture of data is useful for enhancing GS performance in dynamic scenarios.

机器人虚实融合高斯点云通信优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。