用视觉与无线信号联合建模,实现远程机器人低通信量下的稳定控制。
Coupled Control and Wireless World Models for Resilient Remote Robotic Control

- 通过视觉与无线信号联合嵌入预测架构,同步建模机器人状态和信道变化。
- 通信效率提升40%以上,导航性能在弱信号下仍保持稳定。
- 自适应调整感知表示,无需重训控制策略,适合动态环境部署。
在无线网络上运行的远程机器人系统需在通信资源有限、信道条件变化及环境干扰下保持可靠控制。持续传输高维感官数据(如图像)会增加通信开销与能耗,并降低连接不可靠时的鲁棒性。本文提出一种基于耦合控制与无线联合嵌入预测架构(JEPA)世界模型的抗扰远程控制框架,从视觉观测及射频谱图与持久图像(PIs)组合表征中联合捕捉机器人动力学与无线信道演化。学习到的隐变量表示可联合预测未来机器人状态与无线条件,从而减少不必要的上行传输,同时维持可靠控制性能。此外,一种自适应韧性机制能检测隐空间预测偏差,无需重训练完整控制策略即可高效调整感知嵌入以应对无线与视觉环境变化。在同步的Gazebo-ROS-Sionna仿真环境中,该框架在多种无线传播与感知扰动下表现出显著提升的通信效率、鲁棒性与韧性,相比传统比例积分微分(PID)、无模型深度Q网络(DQN)及基于视觉变换器(ViTs)的预测方法,导航性能更优。
原文摘要 · Abstract (English)
Remote robotic systems operating over wireless networks must maintain reliable control despite limited communication resources, changing channel conditions, and environmental disturbances.However, continuously transmitting high-dimensional sensory observations, such as camera images, increases communication overhead and energy consumption while reducing robustness under unreliable connectivity.To address these challenges, this paper proposes a resilient communication-aware remote robotic control framework based on coupled control and wireless Joint Embedding Predictive Architecture (JEPA) world models that jointly capture robot dynamics and wireless channel evolution from visual observations and a combination of raw and structured radio frequency (RF) representations based on spectrograms and Persistence Images(PIs).The learned latent representations enable predictive communication scheduling by jointly forecasting future robot states and wireless conditions, thereby reducing unnecessary uplink transmissions while maintaining reliable control performance.Furthermore, an adaptive resilience mechanism detects latent prediction discrepancies and efficiently adapts perception embeddings to accommodate wireless and visual environmental changes without retraining the complete control policy.The proposed framework is evaluated in a synchronized Gazebo-Robot Operating System (ROS)-Sionna robot-wireless simulation environment under diverse wireless propagation and perception perturbations.Experimental results demonstrate significant improvements in communication efficiency, robustness, and resilience while maintaining navigation performance compared with conventional Proportional Integral Derivative (PID), model-free Deep Q-Network (DQN), and predictive approaches based on Vision Transformers(ViTs).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。