arXiv:2601.13562cs.AIcs.CV2026-01

将推理视为独立模态,提升模型在抽象任务中的表现。

Reasoning is a Modality

  • 设计角色分离的Transformer,区分控制器与工作区
  • 在ARC-1上达到62.6%准确率,超过人类平均60.2%
  • 适合关注可解释性与结构化推理的研究者

抽象与推理语料库(ARC)为研究抽象推理提供了一个紧凑实验平台,这是人类智能的核心能力。现代人工智能系统,包括大语言模型和视觉变压器(ViTs),主要作为行为序列预测机器运行:它们通过建模标记统计来匹配可观测行为,但缺乏持续且可读的心理状态。这导致与人类行为的差距:人类能通过解码内部状态解释行为,而AI系统只能生成看似合理但无状态基础的后见之明。我们假设推理是一种独立模态——应作为与规则应用低层工作区分离的独立通道存在。为验证此假设,在将ARC任务视为视觉推理问题时,我们设计了一种新型角色分离Transformer块,将全局控制器标记与网格工作区标记分离,支持迭代规则执行。在VARC视觉中心协议下训练与评估,我们的方法在ARC-1上达到62.6%准确率,超过平均人类性能(60.2%),显著优于先前方法。定性上,模型表现出比密集式ViT基线更连贯的规则应用结构,表明从似然概率云向控制器驱动推理的转变。

原文摘要 · Abstract (English)

The Abstraction and Reasoning Corpus (ARC) provides a compact laboratory for studying abstract reasoning, an ability central to human intelligence. Modern AI systems, including LLMs and ViTs, largely operate as sequence-of-behavior prediction machines: they match observable behaviors by modeling token statistics without a persistent, readable mental state. This creates a gap with human-like behavior: humans can explain an action by decoding internal state, while AI systems can produce fluent post-hoc rationalizations that are not grounded in such a state. We hypothesize that reasoning is a modality: reasoning should exist as a distinct channel separate from the low-level workspace on which rules are applied. To test this hypothesis, on solving ARC tasks as a visual reasoning problem, we designed a novel role-separated transformer block that splits global controller tokens from grid workspace tokens, enabling iterative rule execution. Trained and evaluated within the VARC vision-centric protocol, our method achieved 62.6% accuracy on ARC-1, surpassing average human performance (60.2%) and outperforming prior methods significantly. Qualitatively, our models exhibit more coherent rule-application structure than the dense ViT baseline, consistent with a shift away from plausible probability blobs toward controller-driven reasoning.

推理机制视觉推理模型可解释性Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。