arXiv:2507.05561cs.LGq-bio.NC2025-07被引 2

人类和机器通过预演未执行任务来提前学习,提升多任务适应能力。

Preemptive Solving of Future Problems: Multitask Preplay in Humans and Machines

  • 利用已有任务经验预演未执行任务,生成反事实模拟。
  • 在网格世界和Minecraft类环境中预测人类泛化表现,准确率更高。
  • 适用于复杂多任务场景,适合研究通用智能与迁移学习的学者。

人类能追求无限多样的任务,但通常只能同时处理少量。我们假设人类会利用某一任务的经验,预先学习那些可及但未执行的任务解决方案。为此提出多任务预演(Multitask Preplay)算法:将一个任务的经验作为起点,进行反事实模拟(即‘预演’),以学习可支持快速适应的预测性表征。实验表明,在小型网格世界中,相比传统规划与预测表征方法,该方法更准确预测人类对未执行但可及任务的泛化行为,即使参与者事先不知需泛化。结果进一步扩展至部分可观测的2D Minecraft环境Craftax。此外,该算法使人工智能体学会可迁移到共享任务共现结构的新Craftax世界的策略。这些发现表明,多任务预演是一种可扩展的人类反事实学习与泛化理论;赋予智能体相同能力,可显著提升其在复杂多任务环境中的表现。

原文摘要 · Abstract (English)

Humans can pursue a near-infinite variety of tasks, but typically can only pursue a small number at the same time. We hypothesize that humans leverage experience on one task to preemptively learn solutions to other tasks that were accessible but not pursued. We formalize this idea as Multitask Preplay, a novel algorithm that replays experience on one task as the starting point for "preplay" -- counterfactual simulation of an accessible but unpursued task. Preplay is used to learn a predictive representation that can support fast, adaptive task performance later on. We first show that, compared to traditional planning and predictive representation methods, multitask preplay better predicts how humans generalize to tasks that were accessible but not pursued in a small grid-world, even when people didn't know they would need to generalize to these tasks. We then show these predictions generalize to Craftax, a partially observable 2D Minecraft environment. Finally, we show that Multitask Preplay enables artificial agents to learn behaviors that transfer to novel Craftax worlds sharing task co-occurrence structure. These findings demonstrate that Multitask Preplay is a scalable theory of how humans counterfactually learn and generalize across multiple tasks; endowing artificial agents with the same capacity can significantly improve their performance in challenging multitask environments.

多任务学习反事实学习智能体泛化游戏环境

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。