用深度学习动态训练模型,让AI在抽象推理任务上表现更优。
Don't throw the baby out with the bathwater: How and why deep learning for ARC
- 测试时实时训练网络与优化器,提升泛化能力
- 结合TTFT和AIRV技术,准确率最高提升300%
- 适合研究通用人工智能与复杂推理的学者
抽象与推理语料库(ARC-AGI)对AI系统构成严峻挑战。尽管深度学习在该任务上表现通常不佳,但其仍是跨视觉、语言等多模态任务中生成高性能神经网络的最有效方法。本文坚持采用深度学习范式,引入测试时动态训练机制。将神经网络与优化器均作为推理过程的核心组件,实现对未见任务的泛化。提出基于预训练大模型的训练方法,并引入测试时微调(TTFT)和反向增强投票(AIRV)技术。首次证明深度学习可高效应用于ARC任务,使用AIRV使准确率最高提升260%,结合TTFT再提升300%。早期版本获2023年ARCathon竞赛第一名,最终版本在ARC私有测试集上达到58%最佳成绩。研究揭示了陌生领域中鲁棒推理系统的关键要素,强化了广泛感知推理的机制。
原文摘要 · Abstract (English)
The Abstraction and Reasoning Corpus (ARC-AGI) presents a formidable challenge for AI systems. Despite the typically low performance on ARC, the deep learning paradigm remains the most effective known strategy for generating skillful (state-of-the-art) neural networks (NN) across varied modalities and tasks in vision, language etc. The deep learning paradigm has proven to be able to train these skillful neural networks and learn the abstractions needed in these diverse domains. Our work doubles down on that and continues to leverage this paradigm by incorporating on-the-fly NN training at test time. We demonstrate that fully committing to deep learning's capacity to acquire novel abstractions yields state-of-the-art performance on ARC. Specifically, we treat both the neural network and the optimizer (rather than just a pre-trained network) as integral components of the inference process, fostering generalization to unseen tasks. Concretely, we propose a methodology for training on ARC, starting from pretrained LLMs, and enhancing their ARC reasoning. We also propose Test-Time Fine-Tuning (TTFT) and the Augment Inference Reverse-Augmentation and Vote (AIRV) as effective test-time techniques. We are the first to propose and show deep learning can be used effectively for ARC, showing boosts of up to 260% in accuracy with AIRV and a further 300% boost with TTFT. An early version of this approach secured first place in the 2023 ARCathon competition, while the final version achieved the current best score on the ARC private test-set (58%). Our findings highlight the key ingredients of a robust reasoning system in unfamiliar domains, underscoring the central mechanisms that improve broad perceptual reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。