通过分阶段隔离提升大模型归纳推理能力,让思维过程更严谨。
Think Through a Bottleneck: Hourglass Reasoning for Rigorous Induction
- 将推理拆分为压缩、推导、生成和修正四阶段,仅允许符号化结果传递
- 在ARC-AGI上提升14分,芯片设计准确率从31%升至58%
- 适合需要高精度归纳的复杂任务,如语言奥赛和硬件合成
自洽精炼常无法增强大语言模型的少样本归纳推理能力。单纯提示模型陈述其推断规则作用有限。真正关键在于推理各阶段间结构化的信息隔离,使信息只能以压缩的符号状态传递。本文提出Hourglass推理机制,严格隔离各推理阶段。冻结的LLM作为元构造器,为每项任务构建符号编码-解码结构:归纳模块将支持样例压缩为模式ϕ(编码器)和临时框架z;推导模块从中提取规则T(解码器)并丢弃z;执行器将(ϕ, T)编译为成果;误差驱动的修正器重审(ϕ, T)并重新生成成果。只有(ϕ, T)跨越阶段边界,所有优化均锚定于规则本身。在视觉抽象、硬件合成与文本规则归纳三个基准测试中评估,使用GPT-5.5与Gemini 3.1 Pro。在ARC-AGI-2上,最佳5次采样准确率较迭代精炼基线提升最高达14分。在ChipBench上,使用GPT-5.5时Verilog合成准确率几乎翻倍,从31%增至58%。BBEH-Linguini采用国际语言学奥林匹克竞赛题目,此前研究显示显式表述反而降低性能。Hourglass缓解此倾向,在Gemini 3.1 Pro上甚至完全逆转效果。消融实验表明,性能提升源于阶段间隔离与初始归纳质量,而非提示措辞或符号形式。信息流动方式而非语言表达,才是冻结LLM归纳推理的核心驱动力。
原文摘要 · Abstract (English)
Self-refinement often fails to strengthen few-shot inductive reasoning in large language models. Prompting a model to explicitly state its inferred rule does little on its own. What actually matters is a structurally enforced isolation between reasoning stages, so that information can only pass between them as a compressed symbolic state. We introduce \textbf{Hourglass reasoning}, which enforces strict context isolation between reasoning stages. The frozen LLM acts as a meta-constructor, building for each task a symbolic encoder--decoder: an Induction module compresses the support examples into a schema $ϕ$ (encoder) and a transient scaffold $z$; a Deduction module derives rule $T$ (decoder) from these and discards $z$; an Implementer compiles $(ϕ, T)$ into artifacts; an error-driven Refiner revises $(ϕ, T)$ and regenerates artifacts from scratch. Only $(ϕ, T)$ crosses stage boundaries, so all refinement stays anchored to the rule. We evaluate Hourglass across three benchmarks spanning visual abstraction, hardware synthesis, and textual rule induction, using GPT-5.5 and Gemini 3.1 Pro. On ARC-AGI-2, it raises best-of-5 accuracy by up to 14 points over an iterative-refinement baseline. On ChipBench, it nearly doubles Verilog synthesis accuracy with GPT-5.5, from 31\% to 58\%. BBEH-Linguini draws on puzzles from the International Linguistics Olympiad, a setting where prior work has shown that explicit verbalization can hurt performance. Hourglass mitigates this tendency, and on Gemini 3.1 Pro, it reverses the effect entirely. Ablations confirm that these gains come from the isolation between stages and the quality of the initial induction, not from prompt wording or the particular symbolic form used. It is how information flows through the reasoning process, rather than the language used to express it, that drives inductive reasoning in frozen LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。