arXiv:2503.06060cs.ROcs.AI2025-03被引 2

用大模型+知识图谱实现机器人任务自适应与故障自动恢复

STAR: A Foundation Model-driven Framework for Robust Task Planning and Failure Recovery in Robotic Systems

  • 结合大模型与动态扩展的知识图谱,实现任务规划与故障恢复
  • 在实验中达到86%的任务规划准确率和78%的恢复成功率
  • 适合长期部署于复杂真实场景的智能机器人系统

现代机器人系统在工业自动化到家庭服务等领域的应用面临动态、不可预测环境下的精确执行与适应性挑战。为此,我们提出STAR(智能任务自适应与恢复)框架,将基础模型(FMs)与动态扩展的知识图谱(KGs)相结合,实现任务规划的鲁棒性和自主故障恢复。尽管基础模型具备出色的泛化能力和上下文推理能力,但其计算效率低、幻觉和输出不一致等问题限制了可靠部署。STAR通过将学习到的知识嵌入结构化、可复用的知识图谱,提升信息检索效率,减少重复的模型计算,并提供精准的场景化洞察。该框架利用基础模型驱动的推理诊断失败,生成上下文感知的恢复策略并执行纠正动作,无需人工干预或系统重启。与依赖固定协议的传统方法不同,STAR能动态扩展知识图谱以积累经验知识,持续适应新场景。为评估效果,我们构建了一个包含多种机器人任务与故障情景的综合性数据集。大量实验表明,STAR在任务规划上达到86%的准确率,在故障恢复上取得78%的成功率,显著优于基线方法。该框架兼具持续学习与结构化知识表示能力,特别适用于现实世界中的长期部署。

原文摘要 · Abstract (English)

Modern robotic systems, deployed across domains from industrial automation to domestic assistance, face a critical challenge: executing tasks with precision and adaptability in dynamic, unpredictable environments. To address this, we propose STAR (Smart Task Adaptation and Recovery), a novel framework that synergizes Foundation Models (FMs) with dynamically expanding Knowledge Graphs (KGs) to enable resilient task planning and autonomous failure recovery. While FMs offer remarkable generalization and contextual reasoning, their limitations, including computational inefficiency, hallucinations, and output inconsistencies hinder reliable deployment. STAR mitigates these issues by embedding learned knowledge into structured, reusable KGs, which streamline information retrieval, reduce redundant FM computations, and provide precise, scenario-specific insights. The framework leverages FM-driven reasoning to diagnose failures, generate context-aware recovery strategies, and execute corrective actions without human intervention or system restarts. Unlike conventional approaches that rely on rigid protocols, STAR dynamically expands its KG with experiential knowledge, ensuring continuous adaptation to novel scenarios. To evaluate the effectiveness of this approach, we developed a comprehensive dataset that includes various robotic tasks and failure scenarios. Through extensive experimentation, STAR demonstrated an 86% task planning accuracy and 78% recovery success rate, showing significant improvements over baseline methods. The framework's ability to continuously learn from experience while maintaining structured knowledge representation makes it particularly suitable for long-term deployment in real-world applications.

机器人任务规划故障恢复知识图谱

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。