让植物与机器人通过大模型对话协同,实现跨生命体自主响应。
Plantbot: Integrating Plant and Robot through LLM Modular Agent Networks
- 用大模型模块分工处理感知、视觉、对话和行动,自然语言作为通用通信协议。
- 植物状态可转化为机器人动作,实现环境变化下的自主响应。
- 适合对生物-机器融合、具身智能感兴趣的读者。
我们提出Plantbot,一种将活体植物与移动机器人通过大型语言模型(LLM)模块网络连接的混合生命体。每个模块(负责感知、视觉、对话或行动)异步运行,通过自然语言通信,实现生物与人工系统间的无缝交互。该架构利用LLM作为混合接口,以自然语言为通用协议,将多模态数据(土壤湿度、温度、视觉上下文)转化为语言信息,协调系统行为。集成网络将植物状态转化为机器人动作,在感知-运动回路中植入规范性,赋予其代理能力。通过LLM中介的生物-机器人协同,Plantbot表现为一个具身的、自适应的智能体,能自主响应环境变化。这一方法为人工生命提供了新范式,表明去中心化的LLM模块协作可促成生物与人工系统间的新互动。
原文摘要 · Abstract (English)
We introduce Plantbot, a hybrid lifeform that connects a living plant with a mobile robot through a network of large language model (LLM) modules. Each module - responsible for sensing, vision, dialogue, or action - operates asynchronously and communicates via natural language, enabling seamless interaction across biological and artificial domains. This architecture leverages the capacity of LLMs to serve as hybrid interfaces, where natural language functions as a universal protocol, translating multimodal data (soil moisture, temperature, visual context) into linguistic messages that coordinate system behaviors. The integrated network transforms plant states into robotic actions, installing normativity essential for agency within the sensor-motor loop. By combining biological and robotic elements through LLM-mediated communication, Plantbot behaves as an embodied, adaptive agent capable of responding autonomously to environmental conditions. This approach suggests possibilities for a new model of artificial life, where decentralized, LLM modules coordination enable novel interactions between biological and artificial systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。