自然智能以少胜多,启发人工智能向高效、可解释方向进化。
Less is More: some Computational Principles based on Parcimony, and Limitations of Natural Intelligence
- 从神经带宽限制出发,催生简洁编码与符号化表征。
- 混沌穿梭机制使大脑灵活记忆与应对不确定性。
- 强调主动探索与真实交互,适合构建类脑AI系统。
自然智能(NI)始终以极少资源实现高效表现:婴儿在数据稀疏、神经与能量受限条件下,仍能习得语言、形成抽象概念并掌握感知运动技能。相比之下,现代人工智能依赖海量算力、能源和数据。本文认为,自然智能的约束实为效率、适应性与创造力的催化剂。首先,有限神经带宽促使生成紧凑编码,同时保留复杂模式,从而自然涌现脉冲神经元、层级结构与类符号表征,支持鲁棒泛化。其次,通过混沌穿梭机制,大脑可在瞬态吸引子间动态切换,灵活检索记忆并处理不确定性。再者,随机投影的储备池计算可实现小样本快速泛化。结合发育视角,内在动机与响应式社会环境共同驱动婴儿语言学习与意义发现。这些主动、具身过程在当前AI中普遍缺失。最后,我们提出‘少即是多’原则——引入能量约束、简约架构与真实世界互动,或可推动更高效、可解释且生物可信的人工智能系统出现。
原文摘要 · Abstract (English)
Natural intelligence (NI) consistently achieves more with less. Infants learn language, develop abstract concepts, and acquire sensorimotor skills from sparse data, all within tight neural and energy limits. In contrast, today's AI relies on virtually unlimited computational power, energy, and data to reach high performance. This paper argues that constraints in NI are paradoxically catalysts for efficiency, adaptability, and creativity. We first show how limited neural bandwidth promotes concise codes that still capture complex patterns. Spiking neurons, hierarchical structures, and symbolic-like representations emerge naturally from bandwidth constraints, enabling robust generalization. Next, we discuss chaotic itinerancy, illustrating how the brain transits among transient attractors to flexibly retrieve memories and manage uncertainty. We then highlight reservoir computing, where random projections facilitate rapid generalization from small datasets. Drawing on developmental perspectives, we emphasize how intrinsic motivation, along with responsive social environments, drives infant language learning and discovery of meaning. Such active, embodied processes are largely absent in current AI. Finally, we suggest that adopting 'less is more' principles -- energy constraints, parsimonious architectures, and real-world interaction -- can foster the emergence of more efficient, interpretable, and biologically grounded artificial systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。