用自然语言让多个大模型协作,实现无需调优的智能机器人行为。
A Paragraph is All It Takes: Rich Robot Behaviors from Interacting, Trusted LLMs
- 四个大模型通过自然语言通信,以人类脑速(40比特/秒)协同决策。
- 在1Hz数据融合频率下,仍能完成多种任务并展现丰富行为。
- 规则写入以太坊,实现可追溯、不可篡改的行为约束,适合可信机器人研究。
大型语言模型(LLMs)是物理环境与动物及人类行为等公共知识的紧凑表示。将LLMs应用于机器人,可能为实现高度通用、极少甚至无需调优即可胜任多数人类任务的机器人提供路径。除了日益复杂的推理与任务规划外,(经过适当设计的)LLM网络还具备易升级性,并允许人类直接观察机器人的思考过程。本文探索了使用LLMs控制实体机器人的优势、局限与特点。基础系统由四个通过网络套接字和ROS2消息传递实现的人类语言数据总线通信的LLM构成。令人惊讶的是,在机器人数据融合周期仅为1Hz、中心数据总线速率仅约40比特/秒(接近人类大脑速率)的情况下,仍能实现丰富的机器人行为与跨任务的良好表现。采用自然语言进行跨LLM通信,使机器人的推理与决策过程对人类可直接观测,并可通过纯英文编写的一组规则轻松引导系统行为。这些规则被永久写入以太坊——一个全球性的、公开的、抗审查的图灵完备计算机。我们提出,通过使用自然语言作为交互式人工智能间的数据总线,并利用不可篡改的公共账本存储行为约束,有可能构建出兼具出人意料的高性能、可扩展性以及持久对齐人类意图的机器人。
原文摘要 · Abstract (English)
Large Language Models (LLMs) are compact representations of all public knowledge of our physical environment and animal and human behaviors. The application of LLMs to robotics may offer a path to highly capable robots that perform well across most human tasks with limited or even zero tuning. Aside from increasingly sophisticated reasoning and task planning, networks of (suitably designed) LLMs offer ease of upgrading capabilities and allow humans to directly observe the robot's thinking. Here we explore the advantages, limitations, and particularities of using LLMs to control physical robots. The basic system consists of four LLMs communicating via a human language data bus implemented via web sockets and ROS2 message passing. Surprisingly, rich robot behaviors and good performance across different tasks could be achieved despite the robot's data fusion cycle running at only 1Hz and the central data bus running at the extremely limited rates of the human brain, of around 40 bits/s. The use of natural language for inter-LLM communication allowed the robot's reasoning and decision making to be directly observed by humans and made it trivial to bias the system's behavior with sets of rules written in plain English. These rules were immutably written into Ethereum, a global, public, and censorship resistant Turing-complete computer. We suggest that by using natural language as the data bus among interacting AIs, and immutable public ledgers to store behavior constraints, it is possible to build robots that combine unexpectedly rich performance, upgradability, and durable alignment with humans.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。