arXiv:2505.19237cs.AIcs.RO2025-05被引 1

让机器人通过感官运动体验,学会认识自己。

Sensorimotor Self-Recognition in Multimodal Large Language Model-Driven Robots

  • 将多模态大模型接入移动机器人,通过感官互动实现自我识别
  • 系统能推断自身机械属性与运动特征,具备环境与自我的双重意识
  • 适合研究具身智能、人工自我意识的学者与工程师

自我识别——在环境中维持对自身身体的内在表征——是智能自主行为的基础。作为最小自我的核心组成部分,它为更高层次的自我意识发展提供初始基础。近期大型语言模型在融合多模态信息的任务中已达到接近人类的表现,引发人们对部署于非人平台(如机器人)的AI代理具身能力的关注。本文探究多模态大模型是否可通过感官运动体验发展出自我识别能力,方法是将大模型集成至自主移动机器人。实验表明,该系统展现出稳健的环境感知、自我辨识与预测能力,能够推断自身的机器人属性及运动特征。结构方程建模揭示了感官整合如何影响最小自我的不同维度,并与其过去-现在记忆的协调以及层级化内部关联共同驱动自我识别。感官输入的消融测试显示各传感器间存在补偿性交互,证实结构化与情景记忆的关键作用。在获得适当的世界与自身感官信息的前提下,多模态大模型为具身认知系统开启人工自我意识之门。

原文摘要 · Abstract (English)

Self-recognition -- the ability to maintain an internal representation of one's own body within the environment -- underpins intelligent, autonomous behavior. As a foundational component of the minimal self, self-recognition provides the initial substrate from which higher forms of self-awareness may eventually emerge. Recent advances in large language models achieve human-like performance in tasks integrating multimodal information, raising growing interest in the embodiment capabilities of AI agents deployed on nonhuman platforms such as robots. We investigate whether multimodal LLMs can develop self-recognition through sensorimotor experience by integrating an LLM into an autonomous mobile robot. The system exhibits robust environmental awareness, self-identification, and predictive awareness, enabling it to infer its robotic nature and motion characteristics. Structural equation modeling reveals how sensory integration influences distinct dimensions of the minimal self and their coordination with past-present memory, as well as the hierarchical internal associations that drive self-identification. Ablation tests of sensory inputs demonstrate compensatory interactions among sensors and confirm the essential role of structured and episodic memory. Given appropriate sensory information about the world and itself, multimodal LLMs open the door to artificial selfhood in embodied cognitive systems.

具身智能自我识别多模态大模型机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。