arXiv:2510.04817cs.AI2025-10

让大模型推理过程更可控:用自然语言描述下一步意图,自动转为可执行指令。

Natural Language Edge Labelling: Decoupling Intent from Execution in Structured LM Reasoning

  • 用自然语言标签明确表达每一步的意图,再转为结构化控制向量执行
  • 在GSM8K等数据集上实现相同算力下准确率提升,成功效率更高
  • 适合需要可解释、可审计推理过程的研究者和应用开发者

现有结构化大模型推理方法(如思维链、树搜索)常将“做什么”与“怎么做”混在一起,导致行为脆弱、计算效率低且难以审查。本文提出自然语言边标注(NLEL),在搜索边添加自由文本指令,由标注器Λ生成标签,调谐器Ψ将其映射为受约束的控制向量,用于解码、搜索策略、生成批量、检索混合及验证轮次。Ψ采用提示式JSON参数生成,通过严格模式校验与安全默认值的信赖域投影保障稳定。下游选择仍采用树搜索风格,评分公式为S=μ+βσ,深度退火β。我们证明了顶k选择在标签条件下的即时单调性,并量化了选择偏差与控制向量失真的关系。在GSM8K、MATH(子集)、StrategyQA和ARC-Challenge上预注册评估,报告成功率/算力(success@compute)、每成功消耗词数等指标,消融实验涵盖Λ、Ψ、信赖域半径与控制量化。预估结果表明,在相同词数预算下准确率提升,且在算力受限时成功效率更优。NLEL提供一种模型无关、可解释的推理接口,实现意图与执行的解耦。

原文摘要 · Abstract (English)

Controllers for structured LM reasoning (e.g., Chain-of-Thought, self-consistency, and Tree-of-Thoughts) often entangle what to try next with how to execute it, exposing only coarse global knobs and yielding brittle, compute-inefficient, and hard-to-audit behavior. We introduce Natural Language Edge Labelling (NLEL), a labeller-tuner overlay that attaches a free-form natural-language directive to each search edge and translates it into a schema-bounded control vector for decoding, search (branch quotas, exploration $β$), generation bundle size, retrieval mixtures, and verification passes. A labeller $Λ$ emits labels from the parent state and a compact context; a tuner $Ψ$ maps $(P, L, C)\to Π$, with strict schema validation and trust-region projection around safe defaults. Downstream selection remains ToT-style with score $S=μ+βσ$ and depth-annealed $β$. We show NLEL strictly generalizes CoT/ToT, prove an anytime-monotonicity property for top-$k$ selection under label-conditioned bundles, and bound selector shortfall by control-vector distortion, providing decision-relevant justification for guards like trust regions and verification passes. We instantiate $Ψ$ as a prompt-only JSON Parameter Emitter and preregister an evaluation on GSM8K, MATH (subset), StrategyQA, and ARC-Challenge with compute-aware reporting (success@compute, tokens-per-success) and ablations over $Λ$, $Ψ$, trust-region radius, and control quantization; preregistered forecasts anticipate accuracy gains at comparable token budgets and improved success@compute under constraints. NLEL offers an interpretable, model-agnostic interface that separates intent from execution for controllable, auditable LM inference.

大模型推理可解释性思维链控制向量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。