用多机制分解学习,让机器像人一样用少量数据快速掌握学术任务。
Decomposed Inductive Procedure Learning: Learning Academic Tasks with Human-Like Data Efficiency
- 将学习拆解为三种独立机制,模仿人类分步推理
- 仅用几十个示例就达到人类水平的数据效率
- 适合研究人机学习差异与高效AI设计的学者
人类学习依赖专业化——不同认知机制协同实现快速学习。而现代神经网络通常只依赖单一机制:目标函数上的梯度下降。这引发一个问题:人类能否仅凭数十个例子而非数十万数据实现快速学习,是否源于能组合多种专用学习机制?我们通过在线辅导环境中的归纳学习模拟进行消融分析,对比强化学习与更高效三机制符号规则归纳方法,发现将学习分解为多个独立机制可显著提升数据效率,使其接近人类水平。此外,这种分解对效率的影响大于符号与非符号学习之分。当前多数试图使数据驱动机器学习贴近人类学习的研究忽视了两者在学习效率上的巨大差异。我们的结果表明,整合多种专用学习机制可能是弥合这一差距的关键。
原文摘要 · Abstract (English)
Human learning relies on specialization -- distinct cognitive mechanisms working together to enable rapid learning. In contrast, most modern neural networks rely on a single mechanism: gradient descent over an objective function. This raises the question: might human learners' relatively rapid learning from just tens of examples instead of tens of thousands in data-driven deep learning arise from our ability to use multiple specialized mechanisms of learning in combination? We investigate this question through an ablation analysis of inductive human learning simulations in online tutoring environments. Comparing reinforcement learning to a more data-efficient 3-mechanism symbolic rule induction approach, we find that decomposing learning into multiple distinct mechanisms significantly improves data efficiency, bringing it in line with human learning. Furthermore, we show that this decomposition has a greater impact on efficiency than the distinction between symbolic and subsymbolic learning alone. Efforts to align data-driven machine learning with human learning often overlook the stark difference in learning efficiency. Our findings suggest that integrating multiple specialized learning mechanisms may be key to bridging this gap.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。