用苏格拉底式思维链让大模型零样本规划机器人找物任务。
Investigating the Effectiveness of a Socratic Chain-of-Thoughts Reasoning Method for Task Planning in Robotics, A Case Study
- 用苏格拉底提问法增强思维链,引导模型生成空间任务规划。
- 苏格拉底思维链使任务成功率提升,执行时间更短(N=20)。
- 适合想用大模型做零样本机器人规划的研究者与开发者。
大型语言模型(LLMs)在自然语言推理方面展现出前所未有的能力,与此同时,具身智能在机器人领域也迅速发展。尽管在语言和文本推理任务中表现优异,但尚不清楚LLMs是否能在真实世界中通过物理动作完成复杂的空间任务。为此,研究在无需微调的零样本场景下应用LLMs于机器人任务的可行性,这有望显著提升人机交互体验,降低计算成本,并避免底层编程工作。本研究采用GPT-4(Omni)结合Webots仿真环境中的Tiago机器人,开展物体搜索任务。评估了三种基于思维链(CoT)子任务生成的推理策略:(1) 非CoT/非苏格拉底法,(2) 仅使用CoT,(3) 苏格拉底思维链(SocraCoT),按严谨程度递增。性能以任务成功比例和执行时间衡量(N=20)。初步结果表明,在结合思维链推理的基础上,苏格拉底方法可用于生成需空间感知的机器人任务代码。进一步地,提出EVINCE-LoC——一种改进的EVINCE方法,可进一步提升在高度复杂或动态测试场景中的表现。
原文摘要 · Abstract (English)
Large language models (LLMs) have demonstrated unprecedented capability in reasoning with natural language. Coupled with this development is the emergence of embodied AI in robotics. Despite showing promise for verbal and written reasoning tasks, it remains unknown whether LLMs are capable of navigating complex spatial tasks with physical actions in the real world. To this end, it is of interest to investigate applying LLMs to robotics in zero-shot learning scenarios, and in the absence of fine-tuning - a feat which could significantly improve human-robot interaction, alleviate compute cost, and eliminate low-level programming tasks associated with robot tasks. To explore this question, we apply GPT-4(Omni) with a simulated Tiago robot in Webots engine for an object search task. We evaluate the effectiveness of three reasoning strategies based on Chain-of-Thought (CoT) sub-task list generation with the Socratic method (SocraCoT) (in order of increasing rigor): (1) Non-CoT/Non-SocraCoT, (2) CoT only, and (3) SocraCoT. Performance was measured in terms of the proportion of tasks successfully completed and execution time (N = 20). Our preliminary results show that when combined with chain-of-thought reasoning, the Socratic method can be used for code generation for robotic tasks that require spatial awareness. In extension of this finding, we propose EVINCE-LoC; a modified EVINCE method that could further enhance performance in highly complex and or dynamic testing scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。