面向故障检测与恢复的智能通信框架,显著提升机器人响应速度与任务成功率。
Goal-oriented Communication for Fast and Robust Robotic Fault Detection and Recovery
- 基于3D场景图监测空间关系变化实现快速故障检测
- 用小语言模型+知识蒸馏生成高泛化能力恢复动作
- 轻量级目标导向数字孪生优化精细控制,适合工业机器人部署
自主机器人广泛应用于智能工厂,在动态、不确定且有人参与的环境中运行,需具备低延迟、鲁棒的故障检测与恢复(FDR)能力。现有FDR框架存在通信与计算延迟大、运动/轨迹生成不可靠等问题,主要因通信-计算-控制(3C)环路设计未考虑下游FDR目标。为此,我们提出一种新型目标导向通信(GoC)框架,协同设计3C环路以最小化FDR时间并最大化任务成功率(如工件分拣)。故障检测方面,创新定义并提取3D场景图(3D-SG)作为语义表示,通过监测3D-SG中空间关系变化实现故障识别。故障恢复方面,采用低秩适应(LoRA)微调小型语言模型(SLM),并通过知识蒸馏增强其推理与泛化能力,生成机器人恢复动作;同时设计轻量级目标导向数字孪生重建模块,仅使用任务相关物体轮廓重构数字孪生,精细化优化恢复动作。大量仿真结果表明,相比依赖视觉语言模型检测、大语言模型恢复的先进框架,本方法将FDR时间减少最多82.6%,任务成功率提升最多76%。
原文摘要 · Abstract (English)
Autonomous robotic systems are widely deployed in smart factories and operate in dynamic, uncertain, and human-involved environments that require low-latency and robust fault detection and recovery (FDR). However, existing FDR frameworks exhibit various limitations, such as significant delays in communication and computation, and unreliability in robot motion/trajectory generation, mainly because the communication-computation-control (3C) loop is designed without considering the downstream FDR goal. To address this, we propose a novel Goal-oriented Communication (GoC) framework that jointly designs the 3C loop tailored for fast and robust robotic FDR, with the goal of minimising the FDR time while maximising the robotic task (e.g., workpiece sorting) success rate. For fault detection, our GoC framework innovatively defines and extracts the 3D scene graph (3D-SG) as the semantic representation via our designed representation extractor, and detects faults by monitoring spatial relationship changes in the 3D-SG. For fault recovery, we fine-tune a small language model (SLM) via Low-Rank Adaptation (LoRA) and enhance its reasoning and generalization capabilities via knowledge distillation to generate recovery motions for robots. We also design a lightweight goal-oriented digital twin reconstruction module to refine the recovery motions generated by the SLM when fine-grained robotic control is required, using only task-relevant object contours for digital twin reconstruction. Extensive simulations demonstrate that our GoC framework reduces the FDR time by up to 82.6% and improves the task success rate by up to 76%, compared to the state-of-the-art frameworks that rely on vision language models for fault detection and large language models for fault recovery.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。