提出在线学习层次结构的新模型,可实时发现数据中的多层级规律。
Hierarchical Latent Structure Learning through Online Inference
- 用嵌套餐厅过程与序列蒙特卡洛法实现在线分层推断
- 在模拟中比平铺模型更紧凑,支持一次性反向迁移
- 能预测从未见过的特征组合,适合做抽象表征学习
学习系统需在跨经验泛化与任务细节区分间取得平衡。有效学习依赖于同时支持两者的表征。在线潜因模型支持增量推断但假设扁平划分,而层次贝叶斯模型虽能捕捉多层级结构,通常需离线推断。我们提出HOLMES模型——一种通过在线推断进行层次潜结构学习的计算框架。该模型结合嵌套餐厅过程先验与序列蒙特卡洛推断,在无显式潜结构监督下实现可计算的逐次试验推断。模拟结果表明,HOLMES在预测性能上达到平铺模型水平,同时学习到更紧凑的表示,并支持对高层级潜类别的一次性反向迁移。在前向迁移任务中,该模型还对从未出现过的特征组合实现了高于随机水平的结果预测,得益于跨多样训练实例学习的抽象形状级表示。这些成果为序列数据中层次结构的可计算发现提供了新途径。
原文摘要 · Abstract (English)
Learning systems must balance generalization across experiences with discrimination of task-relevant details. Effective learning therefore requires representations that support both. Online latent-cause models support incremental inference but assume flat partitions, whereas hierarchical Bayesian models capture multilevel structure but typically require offline inference. We introduce the \textbf{Hierarchical Online Learning of Multiscale Experience Structure (HOLMES) model}, a computational framework for hierarchical latent structure learning through online inference. HOLMES combines a variation on the nested Chinese Restaurant Process prior with sequential Monte Carlo inference to perform tractable trial-by-trial inference over hierarchical latent representations without explicit supervision over the latent structure. In simulations, HOLMES matched the predictive performance of flat models while learning more compact representations that supported one-shot backward transfer to higher-level latent categories. In a forward transfer task, HOLMES additionally achieved above-chance outcome prediction for stimuli with never-before-seen feature combinations, by exploiting abstract shape-level representations learned across diverse training instances. These results provide a tractable computational framework for discovering hierarchical structure in sequential data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。