用探索思想空间的方法,解决大模型推理中的盲区问题。
Blind Spot Navigation in Large Language Model Reasoning with Thought Space Explorer
- 通过识别关键节点并融合多路径信息生成新分支。
- 在数学和问答任务上提升答案与中间步骤准确率。
- 适合需要高质量推理过程的复杂任务场景。
大语言模型通过思维链等结构化方法展现出强大推理能力。近期研究通过生成并行或树状结构、切换长短推理模式、对齐推理步骤与任务表现来优化思维结构。然而这些方法主要依赖已有逻辑路径,忽略了解空间中未探索区域,导致推理存在盲区,限制了多样性与有效性。为此,我们提出「思想空间探索者」(Thought Space Explorer, TSE)框架,用于导航和扩展思维结构以克服盲区。TSE首先识别高影响关键节点,再融合多条思维链信息生成新节点,最后通过连接策略延伸新分支。我们在数学和问答基准上进行实验,结果表明,相比现有基线方法,TSE不仅提升了最终答案和中间推理步骤的准确率,还实现了更优的效果-效率平衡,更适合实际部署。
原文摘要 · Abstract (English)
Large language models have shown strong reasoning capabilities through chain-structured methods such as Chain-of-Thought. Recent studies optimize thought structures by generating parallel or tree-like structures, switching between long and short reasoning modes, or aligning reasoning steps with task performance. However, these approaches mainly rely on previously generated logical directions of the chains, which ignore the unexplored regions of the solution space. Such a phenomenon is defined as blind spots, which limit the diversity and effectiveness of the reasoning process. To this end, we propose the ``Thought Space Explorer'' (TSE), a framework for navigating and expanding thought structures to overcome blind spots in LLM reasoning. Our TSE first identifies key nodes with high impact, then generates new nodes by integrating information from multiple chains. Finally, it extends new branches through connection strategies. We conduct a series of experiments on math and QA benchmarks. Compared with existing baseline methods, TSE improves the accuracy of both the final answer and intermediate reasoning steps, while maintaining a better effectiveness-efficiency trade-off for practical deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。