arXiv:2511.11079cs.AI2025-11KDD被引 1

构建人类抽象推理过程的数据集,揭示思维演进路径。

ARCTraj: A Dataset and Benchmark of Human Reasoning Trajectories for Abstract Problem Solving

  • 记录人类在视觉任务中逐步操作的时序轨迹
  • 涵盖400个任务、约1万条带时间戳的动作序列
  • 适合研究可解释智能与人机对齐的学者

我们提出ARCTraj,一个用于建模人类在抽象推理语料库(ARC)复杂视觉任务中推理过程的数据集与方法框架。尽管ARC已推动大量关于抽象推理的研究,但现有方法多依赖静态输入输出监督,难以揭示推理随时间的演化过程。ARCTraj通过O2ARC网页界面收集了约1万条时序动作轨迹,覆盖ARC-AGI-1基准中的400个训练任务,每条轨迹包含任务标识、时间戳和成功标签。其统一的推理流程涵盖数据采集、动作抽象、马尔可夫决策过程(MDP)建模及下游学习,支持强化学习、生成建模与序列建模方法如PPO、World Models、GFlowNets、Diffusion agents和Decision Transformers。空间选择、颜色分配与策略收敛性分析揭示了人类推理的结构与多样性。该工作为研究类人推理提供了结构化且可解释的基础,推动可解释性、对齐性与通用智能的发展。

原文摘要 · Abstract (English)

We present ARCTraj, a dataset and methodological framework for modeling human reasoning through complex visual tasks in the Abstraction and Reasoning Corpus (ARC). While ARC has inspired extensive research on abstract reasoning, most existing approaches rely on static input-output supervision, which limits insight into how reasoning unfolds over time. ARCTraj addresses this gap by recording temporally ordered, object-level actions that capture how humans iteratively transform inputs into outputs, revealing intermediate reasoning steps that conventional datasets overlook. Collected via the O2ARC web interface, it contains around 10,000 trajectories annotated with task identifiers, timestamps, and success labels across 400 training tasks from the ARC-AGI-1 benchmark. It further defines a unified reasoning pipeline encompassing data collection, action abstraction, Markov decision process (MDP) formulation, and downstream learning, enabling integration with reinforcement learning, generative modeling, and sequence modeling methods such as PPO, World Models, GFlowNets, Diffusion agents, and Decision Transformers. Analyses of spatial selection, color attribution, and strategic convergence highlight the structure and diversity of human reasoning. Together, these contributions position ARCTraj as a structured and interpretable foundation for studying human-like reasoning, advancing explainability, alignment, and generalizable intelligence.

抽象推理人类行为建模轨迹数据可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。