用自动化方法设计能感知环境的智能体架构,提升任务表现。
Automating the Design of Embodied Agent Architectures

- 构建可编辑的图结构程序框架,支持模拟器感知执行
- 在4类具身任务中实现3倍成功率提升,但存在信息泄露风险
- 适合对智能体架构设计感兴趣的研究者,尤其关注自动化探索
具身智能体通常由感知、记忆、规划和动作模块的手工组合构成。这种模块化设计虽开放了广阔架构空间,但现有系统仍依赖研究者直觉决定信息存储位置、观测处理方式及模型调用连接。尽管已有方法(AAS)实现了文本域智能体的架构自动搜索,但尚未在具身感知智能体上通过模拟器滚动评估。本文引入AgentCanvas——一个带类型图结构的运行时环境,支持具身执行器作为可编辑的节点与连线程序运行,并具备模拟器感知执行和每轮次日志记录能力;同时提出KDLoop,一种循环式编码代理搜索流程,包含提案、批判、实验与蒸馏环节,遇阻时触发反思。我们在四个跨越视觉-语言导航、具身问答与语言控制操作的具身执行器上评估三种AAS变体。结果表明,架构级搜索可在具身任务中带来可部署且方向性的成功率提升,但某一高分候选因信息泄漏被排除。此外,实验揭示了文本域AAS中被掩盖的约束:优化信号可能被滚动噪声遮蔽,搜索易困于局部修改盆地,即使有详细日志,轮次级信用分配也仅部分显现。这些发现刻画了自动化架构搜索在具身智能体中的潜力与当前局限。
原文摘要 · Abstract (English)
Embodied agents are typically built as hand-designed compositions of perception, memory, planning, and action modules. This modularity exposes a large architectural design space, but current systems still rely on researcher intuition to choose where information is stored, how observations are processed, and how model calls are connected. Agent Architecture Search (AAS) automates such design for text-domain agents, but has not been systematically evaluated on perceptual embodied agents through simulator rollouts. We study this transfer. We introduce AgentCanvas, a typed-graph runtime that hosts embodied executors as editable node-and-wire programs with simulator-aware execution and episode-level logs, and KDLoop, a coding-agent search procedure that cycles through proposal, critique, experiment, and distillation, with triggered reflection after stalls. We evaluate three AAS variants across four embodied executors spanning vision-language navigation, embodied question answering, and language-conditioned manipulation. The resulting 3x4 matrix shows that architecture-level search can produce deployable and directional success-rate gains on embodied tasks, while one apparent high-scoring candidate is rejected as leak-bearing. At the same time, the experiments expose constraints that are muted in text-domain AAS: optimization signals can be masked by rollout noise, search can become trapped in local edit basins, and episode-level credit assignment only partially emerges even when detailed logs are available. These results characterize both the promise and the current limits of automated architecture search for embodied agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。