用神经符号融合与动态适配提升少样本推理能力
ARC-AGI-2 Technical Report
- 将任务编码为125词的序列,用长上下文Transformer建模
- 测试时训练+轻量微调使模型自适应新任务,准确率显著提升
- 通过对称性解码实现多视角推理,提升答案一致性
抽象与推理语料库(ARC)旨在评估模型在模式匹配之外的泛化能力,要求从极少数示例中推断符号规则。本文提出一种基于Transformer的系统,通过结合神经推理、结构感知先验和在线任务适配,显著提升ARC性能。核心思路包括:将ARC推理重构为序列建模问题,采用仅125个标记的紧凑任务编码,支持长上下文处理;引入基于群对称性、网格遍历和自动机扰动的规范增强框架,强制对表示变化保持不变;采用测试时训练(TTT)与轻量级LoRA微调,使模型从示范中学习变换逻辑并针对性适应每个未见任务;设计对称性感知的解码与评分流程,跨增强任务视图聚合似然,实现“多视角推理”。实验证明这些组件协同作用:增强扩大假设空间,TTT强化局部推理,对称性评分提高解的一致性。最终系统超越现有神经模型,在性能上接近人类水平通用推理。
原文摘要 · Abstract (English)
The Abstraction and Reasoning Corpus (ARC) is designed to assess generalization beyond pattern matching, requiring models to infer symbolic rules from very few examples. In this work, we present a transformer-based system that advances ARC performance by combining neural inference with structure-aware priors and online task adaptation. Our approach is built on four key ideas. First, we reformulate ARC reasoning as a sequence modeling problem using a compact task encoding with only 125 tokens, enabling efficient long-context processing with a modified LongT5 architecture. Second, we introduce a principled augmentation framework based on group symmetries, grid traversals, and automata perturbations, enforcing invariance to representation changes. Third, we apply test-time training (TTT) with lightweight LoRA adaptation, allowing the model to specialize to each unseen task by learning its transformation logic from demonstrations. Fourth, we design a symmetry-aware decoding and scoring pipeline that aggregates likelihoods across augmented task views, effectively performing ``multi-perspective reasoning'' over candidate solutions. We demonstrate that these components work synergistically: augmentations expand hypothesis space, TTT sharpens local reasoning, and symmetry-based scoring improves solution consistency. Our final system achieves a significant improvement over transformer baselines and surpasses prior neural ARC solvers, closing the gap toward human-level generalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。