受脑科学启发,构建能感知、思考、行动的机器人智能核心
Neural Brain: A Neuroscience-inspired Framework for Embodied Agents
- 模仿大脑结构,整合多模态感知与认知决策
- 支持实时动态适应,具备类人记忆更新能力
- 适合机器人、自动驾驶等需真实交互的场景
人工智能正从静态数据模型向可感知、可交互的动态系统演进。尽管大模型在模式识别和符号推理上取得进展,但其仍缺乏身体性,无法与真实世界互动。这推动了具身智能的发展,要求智能体如人形机器人能在非结构化环境中自主导航与操作。本文提出神经脑(Neural Brain)框架,作为具身智能体的核心系统,实现类人适应能力。该系统需融合多模态感知、认知-行动闭环、可塑性记忆存储与更新,并通过软硬件协同优化实现低功耗实时运行。论文构建了一个统一框架,涵盖主动感知、感知-认知-行动一体化、基于神经可塑性的记忆机制及类脑软硬件优化。同时综述了相关领域最新进展,分析现有系统与人类智能的差距。结合神经科学洞见,提出了迈向通用、自主、人类级智能体的路线图。
原文摘要 · Abstract (English)
The rapid evolution of artificial intelligence (AI) has shifted from static, data-driven models to dynamic systems capable of perceiving and interacting with real-world environments. Despite advancements in pattern recognition and symbolic reasoning, current AI systems, such as large language models, remain disembodied, unable to physically engage with the world. This limitation has driven the rise of embodied AI, where autonomous agents, such as humanoid robots, must navigate and manipulate unstructured environments with human-like adaptability. At the core of this challenge lies the concept of Neural Brain, a central intelligence system designed to drive embodied agents with human-like adaptability. A Neural Brain must seamlessly integrate multimodal sensing and perception with cognitive capabilities. Achieving this also requires an adaptive memory system and energy-efficient hardware-software co-design, enabling real-time action in dynamic environments. This paper introduces a unified framework for the Neural Brain of embodied agents, addressing two fundamental challenges: (1) defining the core components of Neural Brain and (2) bridging the gap between static AI models and the dynamic adaptability required for real-world deployment. To this end, we propose a biologically inspired architecture that integrates multimodal active sensing, perception-cognition-action function, neuroplasticity-based memory storage and updating, and neuromorphic hardware/software optimization. Furthermore, we also review the latest research on embodied agents across these four aspects and analyze the gap between current AI systems and human intelligence. By synthesizing insights from neuroscience, we outline a roadmap towards the development of generalizable, autonomous agents capable of human-level intelligence in real-world scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。