用意图与约束对引导大模型搜索,提升复杂任务规划的准确性和可行性。
Constraints-of-Thought: A Framework for Constrained Reasoning in Language-Model-Guided Search
- 将每步推理表示为(意图,约束)对,压缩搜索空间并限制无效动作。
- 在三个领域实验中,准确率和结构对齐度均优于基线方法。
- 适合需要严格约束的复杂规划任务,如游戏策略、代码生成等。
尽管大语言模型在多步规划方面取得进展,但在复杂多步场景中仍难以保证计划与用户高层意图一致并满足符号约束。现有方法如思维链(CoT)、树状思维(ToT)及验证器增强方法虽扩展了搜索空间,却常产生不可行动作或幻觉步骤。为此,本文提出约束之思(Const-o-T)框架,通过结构化先验引导蒙特卡洛树搜索(MCTS)聚焦于语义上合理路径。每个推理步骤以(意图,约束)对表示,既压缩搜索空间,又确保有效性。与仅生成推理轨迹或事后验证的方法不同,Const-o-T主动利用(意图,约束)对引导搜索,使探索集中于可执行且有意义的动作。我们在风险游戏、CAD代码生成和算术推理三个领域验证该方法,结果表明其在准确率和结构对齐性上均优于基线。本研究证明,约束之思为约束引导推理提供了通用基础,实现更高效、对齐约束且可跨领域适配的大模型规划。
原文摘要 · Abstract (English)
While researchers have made significant progress in enabling large language models (LLMs) to perform multi-step planning, LLMs struggle to ensure that those plans align with high-level user intent and satisfy symbolic constraints, especially in complex, multi-step domains. Existing reasoning approaches such as Chain-of-Thought (CoT), Tree-of-Thought (ToT), and verifier-augmented methods, expand the search space but often yield infeasible actions or hallucinated steps. To overcome these limitations, we propose Constraints-of-Thought (Const-o-T), a framework that provides a structured prior that enables Monte Carlo Tree Search (MCTS) focus search on semantically meaningful paths. Each reasoning step is represented as an (intent, constraint) pair, which serves both to compress the search space and enforce validity. Unlike prior methods that merely generate reasoning traces or validate outputs post hoc, Const-o-T uses (intent, constraint)pairs to actively focus the search toward feasible and meaningful plans. We integrate Const-o-T into MCTS using a structured representation of intent-constraint pairs constraints prune infeasible branches and guide exploration toward semantically valid actions, improving planning efficiency and verifiable decision-making. We demonstrate across three domains Risk game, CAD code generation, and arithmetic reasoning that our approach outperforms baselines, yielding higher accuracy and stronger structural alignment. Our contribution is to demonstrate that Const-of-T offers a generalizable foundation for constraint-guided reasoning, enabling more efficient, constraint-aligned, and domain-adaptable planning with LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。