用知识图谱和检索增强生成,让水下机器人团队自主协作并保持人类可控。
Advancing Shared and Multi-Agent Autonomy in Underwater Missions: Integrating Knowledge Graphs and Retrieval-Augmented Generation
- 构建融合知识图谱与领域分类的RAG系统,支撑多机器人自主决策。
- 实现100%任务验证率与行为完整性,显著提升水下任务可靠性。
- 适合需高可信度自主系统的海洋探测、巡检等场景应用。
机器人平台已成为海洋作业的关键工具,用于海底设施巡检、环境监测与资源勘探等任务。然而,水下环境复杂多变,存在能见度低、洋流不可预测及通信受限等问题,对机器人自主性提出严峻挑战,同时需保障操作员信任与监督。本研究聚焦知识表示与推理技术,特别是知识图谱与检索增强生成(RAG)系统,使机器人能高效组织、检索并理解复杂环境数据,从而实现有效推理、适应与响应。核心目标是展示多智能体自主与共享自主能力:多个机器人独立运行,同时与人类监管者保持连接。实验表明,基于知识图谱与领域分类体系增强的大型语言模型(LLM),可实现自主多智能体决策,并支持无缝人机交互,最终达成100%的任务验证率与行为完整性。消融实验进一步揭示,若缺乏图谱或分类体系提供的结构化知识,LLM易产生幻觉,导致决策质量下降。
原文摘要 · Abstract (English)
Robotic platforms have become essential for marine operations by providing regular and continuous access to offshore assets, such as underwater infrastructure inspection, environmental monitoring, and resource exploration. However, the complex and dynamic nature of underwater environments, characterized by limited visibility, unpredictable currents, and communication constraints, presents significant challenges that demand advanced autonomy while ensuring operator trust and oversight. Central to addressing these challenges are knowledge representation and reasoning techniques, particularly knowledge graphs and retrieval-augmented generation (RAG) systems, that enable robots to efficiently structure, retrieve, and interpret complex environmental data. These capabilities empower robotic agents to reason, adapt, and respond effectively to changing conditions. The primary goal of this work is to demonstrate both multi-agent autonomy and shared autonomy, where multiple robotic agents operate independently while remaining connected to a human supervisor. We show how a RAG-powered large language model, augmented with knowledge graph data and domain taxonomy, enables autonomous multi-agent decision-making and facilitates seamless human-robot interaction, resulting in 100\% mission validation and behavior completeness. Finally, ablation studies reveal that without structured knowledge from the graph and/or taxonomy, the LLM is prone to hallucinations, which can compromise decision quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。