从感知序列中学习模式与抽象,揭示人类认知的高效结构化机制。
Learning Patterns and Abstractions from Perceptual Sequences
- 提出分块与抽象作为认知核心原则,实现序列的层次化解析
- 模型能发现多维序列中的嵌套结构并用于迁移与组合生成
- 适用于理解人类记忆、语言学习及复杂系统建模
认知会迅速将高维感官流分解为熟悉的部分并发现其关系。为何结构会浮现?它们如何促进学习、泛化与预测?其背后的计算原理是什么?简化后,感官流可视为一维序列。在学习此类序列时,人会自然将其分割为片段——即分块。第一项研究探讨了串行反应时任务中影响分块的因素,表明人类能适应底层分块,同时权衡速度与准确率。在此基础上,我构建了可逐块学习与解析序列的模型。从规范角度,我将分块视为发现重复模式与嵌套层次的理性策略,实现序列的有效因子分解。学习到的分块作为可复用基元,支持迁移、组合与心理模拟,使模型能从已知构造新内容。我展示了该模型在单维与多维序列中学习层次结构的能力,并凸显其在无监督模式发现中的价值。第二部分转向抽象序列。我对抽象模式进行了分类,探究其在序列记忆中的作用。行为证据表明,人类利用模式冗余实现压缩与迁移。我提出了非参数化的分层变量模型,可同时学习分块与抽象变量,揭示不变的符号模式。该模型表现出与人类学习的相似性,并与大语言模型进行对比。总体而言,本论文表明分块与抽象作为简单计算原则,可在从简单到复杂、从具体到抽象的层次化序列中实现结构化知识获取。
原文摘要 · Abstract (English)
Cognition swiftly breaks high-dimensional sensory streams into familiar parts and uncovers their relations. Why do structures emerge, and how do they enable learning, generalization, and prediction? What computational principles underlie this core aspect of perception and intelligence? A sensory stream, simplified, is a one-dimensional sequence. In learning such sequences, we naturally segment them into parts -- a process known as chunking. In the first project, I investigated factors influencing chunking in a serial reaction time task and showed that humans adapt to underlying chunks while balancing speed and accuracy. Building on this, I developed models that learn chunks and parse sequences chunk by chunk. Normatively, I proposed chunking as a rational strategy for discovering recurring patterns and nested hierarchies, enabling efficient sequence factorization. Learned chunks serve as reusable primitives for transfer, composition, and mental simulation -- letting the model compose the new from the known. I demonstrated this model's ability to learn hierarchies in single and multi-dimensional sequences and highlighted its utility for unsupervised pattern discovery. The second part moves from concrete to abstract sequences. I taxonomized abstract motifs and examined their role in sequence memory. Behavioral evidence suggests that humans exploit pattern redundancies for compression and transfer. I proposed a non-parametric hierarchical variable model that learns both chunks and abstract variables, uncovering invariant symbolic patterns. I showed its similarity to human learning and compared it to large language models. Taken together, this thesis suggests that chunking and abstraction as simple computational principles enable structured knowledge acquisition in hierarchically organized sequences, from simple to complex, concrete to abstract.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。