模仿大脑皮层柱结构,实现快速、持续的3D物体感知与推理。
Thousand-Brains Systems: Sensorimotor Intelligence for Rapid, Robust Learning and Inference
- 基于上千个独立模块构建传感器运动智能系统,模拟生物大脑学习机制。
- 在YCB数据集上实现高鲁棒性3D物体识别与姿态估计,能自然捕捉对称性。
- 通过投票算法加速推理,支持快速连续学习,适合机器人视觉等场景。
当前AI系统在诸多任务上表现优异,但缺乏生物智能的核心特征,如快速持续学习、基于感官运动交互的表征以及支持高效泛化的结构化知识。神经科学理论认为哺乳动物通过复制半独立的感官运动模块——即皮层柱——进化出灵活智能。为弥合生物与人工智能的差距,提出千脑系统以模仿皮层柱及其相互作用。本文评估了蒙蒂(Monty)——首个千脑系统实现——的独特性能,聚焦3D物体感知,特别是物体识别与姿态估计联合任务。利用家用物品数据集YCB,我们发现蒙蒂通过感官运动学习构建的结构化表征具备强泛化能力,其表征强调全局形状分类,并自然检测物体对称性。进一步研究显示,模型无关与模型依赖策略结合,支持有原则的动作规划,实现快速推断;模块化架构支持模块间通信,通过新型‘投票’算法进一步提升推理速度。最后,通过类赫布关联绑定机制,实现快速、持续且计算高效的持续学习,优于现有深度学习架构。尽管蒙蒂尚处初期开发阶段,这些发现支持千脑系统作为人工智能的新范式具有强大潜力。
原文摘要 · Abstract (English)
Current AI systems achieve impressive performance on many tasks, yet they lack core attributes of biological intelligence, including rapid, continual learning, representations grounded in sensorimotor interactions, and structured knowledge that enables efficient generalization. Neuroscience theory suggests that mammals evolved flexible intelligence through the replication of a semi-independent, sensorimotor module, a functional unit known as a cortical column. To address the disparity between biological and artificial intelligence, thousand-brains systems were proposed as a means of mirroring the architecture of cortical columns and their interactions. In the current work, we evaluate the unique properties of Monty, the first implementation of a thousand-brains system. We focus on 3D object perception, and in particular, the combined task of object recognition and pose estimation. Utilizing the YCB dataset of household objects, we first assess Monty's use of sensorimotor learning to build structured representations, finding that these enable robust generalization. These representations include an emphasis on classifying objects by their global shape, as well as a natural ability to detect object symmetries. We then explore Monty's use of model-free and model-based policies to enable rapid inference by supporting principled movements. We find that such policies complement Monty's modular architecture, a design that can accommodate communication between modules to further accelerate inference speed via a novel `voting' algorithm. Finally, we examine Monty's use of associative, Hebbian-like binding to enable rapid, continual, and computationally efficient learning, properties that compare favorably to current deep learning architectures. While Monty is still in a nascent stage of development, these findings support thousand-brains systems as a powerful and promising new approach to AI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。