用连续流模型实现可迭代修正的高效结构化推理
Flow Reasoning Models: Turning Flows Into Efficient Recurrent Reasoners

- 通过自条件机制让模型在推理中反复修正决策
- 在三类难题上解决率超99.5%,且计算量仅为其他方法1/44
- 适合需要高效并行推理的复杂逻辑任务
结构化推理需要做出并修正相互依赖的决策以获得全局一致解。现有架构存在局限:自回归模型逐个决策无法回溯,掩码扩散模型常需复杂解码协调依赖预测。本文提出流动推理模型(FRMs),通过简单循环精炼机制将连续流适配到离散结构输出。通过自条件化流模型的历史输出,将单次去噪转化为迭代优化。使FRMs能并行做出并修正决策,高效协调解决方案中的依赖关系。然而,传统自条件在深度递归时因训练与推理状态不匹配导致不可靠。为此提出定点强制(FPF),在保持标准流匹配目标的同时,用模型自身推理动态生成的状态进行训练。FRMs在Sudoku-Extreme、Zebra和Maze-Unique上的求解率分别为99.5%、100.0%和99.9%。在Sudoku-Extreme上,其峰值准确率高于评估的掩码扩散与专用推理基线,同时仅需44倍更少的推理浮点运算。
原文摘要 · Abstract (English)
Structured reasoning requires making and revising interdependent decisions to reach a globally consistent solution. Existing architectures struggle with this: autoregressive models commit sequentially and cannot revise earlier decisions, while masked diffusion models often require careful decoding schemes to coordinate interdependent predictions. We introduce Flow Reasoning Models (FRMs), a novel framework for structured reasoning that adapts continuous flows over discrete structured outputs with a simple recurrent refinement mechanism. By self-conditioning a flow model on its own past outputs, we turn one-shot denoising into iterative solution refinement. This lets FRMs make and revise decisions in parallel, efficiently coordinating interdependent choices across solutions. Yet conventional self-conditioning becomes unreliable at greater recurrent depth due to exposure bias between one-step training predictions and recursively generated inference states. We address this mismatch with Fixed-Point Forcing (FPF), which trains FRMs on states produced by their own inference dynamics while preserving the standard flow-matching objective. FRMs achieve solve rates of $99.5\%$, $100.0\%$, and $99.9\%$ on Sudoku-Extreme, Zebra, and Maze-Unique, respectively. On Sudoku-Extreme, FRMs achieve higher peak accuracy than the evaluated masked-diffusion and specialized reasoning baselines while remaining highly compute-efficient, matching the next-best method's $98.7\%$ peak solve rate with $44\times$ fewer inference FLOPs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。