机器人用自然语言和逻辑推理协作,无需中央调度。
Ask, Reason, Assist: Robot Collaboration via Natural Language and Temporal Logic
- 用大模型判断是否需帮助,并发出自然语言求助
- 助手用时序逻辑推理响应,计算对自身任务影响
- 能选最优帮手,性能接近中心化方案但更轻量
随着仓储等领域机器人部署增加,异构机器人团队需协同应对突发冲突。本文提出一种点对点协作协议:当机器人检测到冲突时,利用大语言模型(LLM)判断是否需要外部协助;若需,生成并广播自然语言(NL)求助请求。潜在帮助者通过基于信号时序逻辑(STL)的LLM进行推理,采用巴科斯-诺尔范式(BNF)语法确保自然语言到STL的语法正确转换,随后将问题转化为混合整数线性规划(MILP)求解。帮助者响应中包含其正在进行任务受影响的信息。请求者基于预期系统总任务完成时间增加量选择最佳帮手。实验表明,考虑多个应答可最小化新增完工时间(makespan),显著优于仅选最近可用机器人的启发式策略,且性能接近需大量信息的集中式“理想”基线,但通信开销更低。
原文摘要 · Abstract (English)
Increased robot deployment, such as in warehousing, has revealed a need for collaboration among heterogeneous robot teams to resolve unforeseen conflicts. To this end, we propose a peer-to-peer coordination protocol that enables robots to request and provide help without a central task allocator. The process begins when a robot detects a conflict and uses a Large Language Model (LLM) to decide whether external assistance is required. If so, it crafts and broadcasts a natural language (NL) help request. Potential helper robots reason over the request and respond with offers of assistance, including information about the effect on their ongoing tasks. Helper reasoning is implemented via an LLM grounded in Signal Temporal Logic (STL) using a Backus-Naur Form (BNF) grammar, ensuring syntactically valid NL-to-STL translations, which are then solved as a Mixed Integer Linear Program (MILP). Finally, the requester robot selects a helper by reasoning over the expected increase in system-level total task completion time. We evaluated our framework through experiments comparing different helper-selection strategies and found that considering multiple offers allows the requester to minimize added makespan. Our approach significantly outperforms heuristics such as selecting the nearest available candidate helper robot, and achieves performance comparable to a centralized "Oracle" baseline but without heavy information demands.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。