用分块标签压缩时间序列,提升模型对多时标模式的识别能力
Temporal Chunking Enhances Recognition of Implicit Sequential Patterns
- 将时间序列压缩为带上下文标签的块,模仿睡眠期记忆整合机制
- 在资源受限下显著提升学习效率,小样本实验效果优于传统RNN
- 适合研究记忆机制、跨任务迁移的神经科学与认知计算方向
本研究提出一种受神经机制启发的方法,将时间序列压缩为带上下文标签的片段,每个标签代表序列中重复出现的结构单元或‘社区’。这些标签在离线睡眠阶段生成,作为过往经验的紧凑参考,使学习者能利用超出当前输入范围的信息。我们在一个设计精巧的合成环境中评估该方法,揭示了传统基于神经网络的序列学习器(如RNN)在面对多时标模式时的局限性。初步结果表明,在资源受限条件下,时间分块可显著提升学习效率。一次小规模人类试点研究(使用序列反应时任务)进一步支持了结构抽象的合理性。尽管仅限于合成任务,本工作为跨任务迁移提供了早期实证支持,初步证据显示已学习的上下文标签可在相关任务间传递,具备未来应用于迁移学习的潜力。
原文摘要 · Abstract (English)
In this pilot study, we propose a neuro-inspired approach that compresses temporal sequences into context-tagged chunks, where each tag represents a recurring structural unit or``community'' in the sequence. These tags are generated during an offline sleep phase and serve as compact references to past experience, allowing the learner to incorporate information beyond its immediate input range. We evaluate this idea in a controlled synthetic environment designed to reveal the limitations of traditional neural network based sequence learners, such as recurrent neural networks (RNNs), when facing temporal patterns on multiple timescales. We evaluate this idea in a controlled synthetic environment designed to reveal the limitations of traditional neural network based sequence learners, such as recurrent neural networks (RNNs), when facing temporal patterns on multiple timescales. Our results, while preliminary, suggest that temporal chunking can significantly enhance learning efficiency under resource constrained settings. A small-scale human pilot study using a Serial Reaction Time Task further motivates the idea of structural abstraction. Although limited to synthetic tasks, this work serves as an early proof-of-concept, with initial evidence that learned context tags can transfer across related task, offering potential for future applications in transfer learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。