arXiv:2602.05385cs.CL2026-02被引 1

轻量模型实现高效文本转SQL,解决复杂推理与成本问题

IESR:Efficient MCTS-Based Modular Reasoning for Text-to-SQL with Large Language Models

  • 用MCTS多路径推理+投票机制提升逻辑推理能力
  • 在LogicCat和Archer上达24.28和37.28 EX,无需微调
  • 适合资源受限场景的工业级文本转SQL部署

文本转SQL是自然语言处理中的关键任务,可实现用户与数据库的直观交互。尽管现有方法在BIRD和Spider等基准上表现良好,但在复杂推理、领域知识和假设性查询方面仍存在不足,且企业部署成本较高。为此,我们提出IESR(信息增强结构化推理)框架,专为轻量级大模型设计:(i) 利用大模型理解关键信息并链接模式,解耦数学计算与SQL生成;(ii) 引入基于蒙特卡洛树搜索(MCTS)的多路径推理机制并结合多数投票;(iii) 设计轨迹一致性验证模块,通过判别器模型确保结果准确性和一致性。实验表明,IESR仅使用紧凑轻量模型,在LogicCat(24.28 EX)和Archer(37.28 EX)基准上达到当前最优性能,且无需微调。分析还揭示当前编码模型在物理常识、数学计算和常识推理方面存在显著偏差与缺陷,指明未来研究方向。代码已开源:https://github.com/Ffunkytao/IESR-SLM。

原文摘要 · Abstract (English)

Text-to-SQL is a key natural language processing task that maps natural language questions to SQL queries, enabling intuitive interaction with web-based databases. Although current methods perform well on benchmarks like BIRD and Spider, they struggle with complex reasoning, domain knowledge, and hypothetical queries, and remain costly in enterprise deployment. To address these issues, we propose a framework named IESR(Information Enhanced Structured Reasoning) for lightweight large language models: (i) leverages LLMs for key information understanding and schema linking, and decoupling mathematical computation and SQL generation, (ii) integrates a multi-path reasoning mechanism based on Monte Carlo Tree Search (MCTS) with majority voting, and (iii) introduces a trajectory consistency verification module with a discriminator model to ensure accuracy and consistency. Experimental results demonstrate that IESR achieves state-of-the-art performance on the complex reasoning benchmark LogicCat (24.28 EX) and the Archer dataset (37.28 EX) using only compact lightweight models without fine-tuning. Furthermore, our analysis reveals that current coder models exhibit notable biases and deficiencies in physical knowledge, mathematical computation, and common-sense reasoning, highlighting important directions for future research. We released code at https://github.com/Ffunkytao/IESR-SLM.

文本转SQLMCTS轻量模型推理增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。