用两级递归结构模拟人脑推理,小模型也能高效解复杂谜题。
Hierarchical Reasoning Model
- 分层递归设计:高层慢思考规划,底层快计算执行。
- 仅2700万参数+1000样本训练,解数独和迷宫路径接近完美。
- 无需预训练或思维链数据,比大模型更优,适合通用推理系统。
推理是制定并执行复杂目标导向动作序列的关键挑战。当前大语言模型主要依赖思维链(CoT)方法,存在任务分解脆弱、数据需求量大、延迟高等问题。受人类大脑分层多时标处理机制启发,我们提出层级推理模型(HRM),一种新型循环架构,在保持训练稳定与高效的同时实现显著计算深度。HRM通过两个相互依赖的循环模块,在单次前向传播中完成序列推理任务,无需中间过程显式监督:高层模块负责缓慢抽象规划,底层模块处理快速详细计算。仅使用2700万参数和1000个训练样本,HRM在复杂推理任务上表现优异,无需预训练或CoT数据即可近乎完美解决复杂数独谜题和大型迷宫最优路径寻找问题。此外,HRM在衡量通用人工智能能力的关键基准——抽象与推理语料库(ARC)上,优于参数更大、上下文窗口更长的模型。这些结果凸显了HRM在通向通用计算与通用推理系统方面的变革潜力。
原文摘要 · Abstract (English)
Reasoning, the process of devising and executing complex goal-oriented action sequences, remains a critical challenge in AI. Current large language models (LLMs) primarily employ Chain-of-Thought (CoT) techniques, which suffer from brittle task decomposition, extensive data requirements, and high latency. Inspired by the hierarchical and multi-timescale processing in the human brain, we propose the Hierarchical Reasoning Model (HRM), a novel recurrent architecture that attains significant computational depth while maintaining both training stability and efficiency. HRM executes sequential reasoning tasks in a single forward pass without explicit supervision of the intermediate process, through two interdependent recurrent modules: a high-level module responsible for slow, abstract planning, and a low-level module handling rapid, detailed computations. With only 27 million parameters, HRM achieves exceptional performance on complex reasoning tasks using only 1000 training samples. The model operates without pre-training or CoT data, yet achieves nearly perfect performance on challenging tasks including complex Sudoku puzzles and optimal path finding in large mazes. Furthermore, HRM outperforms much larger models with significantly longer context windows on the Abstraction and Reasoning Corpus (ARC), a key benchmark for measuring artificial general intelligence capabilities. These results underscore HRM's potential as a transformative advancement toward universal computation and general-purpose reasoning systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。