arXiv:2506.08296cs.RO2025-06被引 2

受大脑启发的多智能体系统,让机器人更高效完成复杂操作。

HiBerNAC: Hierarchical Brain-emulated Robotic Neural Agent Collective for Disentangling Complex Manipulation

  • 模仿大脑层级决策机制,用多个智能体协同完成任务。
  • 长序列任务平均提速23%,多路径任务成功率提升至12%~31%。
  • 适合需要动态协作与长期规划的复杂机器人操作场景。

多模态视觉-语言-动作(VLA)模型的进展推动了机器人学习的革新,使系统能在统一框架中理解视觉、语言和动作以进行复杂任务规划。然而,掌握复杂操作任务仍面临挑战,受限于持续上下文记忆不足、不确定性下的多智能体协调困难,以及跨可变序列的动态长时程规划能力。为此,我们提出 extbf{HiBerNAC}——一种受神经科学突破启发的层级脑模拟机器人神经智能体集体框架,结合多模态VLA规划推理与神经启发的反思及多智能体机制,专为复杂机器人操作设计。通过神经启发的功能模块与去中心化多智能体协作,该方法实现了复杂操作任务的鲁棒且增强的实时执行。此外,该代理系统通过动态智能体专业化实现可扩展的集体智能,能自适应不同任务时长与复杂度。在多个复杂操作任务上的实验表明,与最先进的VLA模型相比, extbf{HiBerNAC}将平均长时程任务完成时间减少23%,并在先前最先进模型持续失败的多路径任务上达到12%~31%的非零成功率。这些结果为连接生物认知与机器人学习机制提供了初步证据。

原文摘要 · Abstract (English)

Recent advances in multimodal vision-language-action (VLA) models have revolutionized traditional robot learning, enabling systems to interpret vision, language, and action in unified frameworks for complex task planning. However, mastering complex manipulation tasks remains an open challenge, constrained by limitations in persistent contextual memory, multi-agent coordination under uncertainty, and dynamic long-horizon planning across variable sequences. To address this challenge, we propose \textbf{HiBerNAC}, a \textbf{Hi}erarchical \textbf{B}rain-\textbf{e}mulated \textbf{r}obotic \textbf{N}eural \textbf{A}gent \textbf{C}ollective, inspired by breakthroughs in neuroscience, particularly in neural circuit mechanisms and hierarchical decision-making. Our framework combines: (1) multimodal VLA planning and reasoning with (2) neuro-inspired reflection and multi-agent mechanisms, specifically designed for complex robotic manipulation tasks. By leveraging neuro-inspired functional modules with decentralized multi-agent collaboration, our approach enables robust and enhanced real-time execution of complex manipulation tasks. In addition, the agentic system exhibits scalable collective intelligence via dynamic agent specialization, adapting its coordination strategy to variable task horizons and complexity. Through extensive experiments on complex manipulation tasks compared with state-of-the-art VLA models, we demonstrate that \textbf{HiBerNAC} reduces average long-horizon task completion time by 23\%, and achieves non-zero success rates (12\textendash 31\%) on multi-path tasks where prior state-of-the-art VLA models consistently fail. These results provide indicative evidence for bridging biological cognition and robotic learning mechanisms.

机器人多智能体脑启发

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。