用可解释的评语实现细粒度文本转SQL评估,无需人工标注
Beyond Query-Level Comparison: Fine-Grained Reinforcement Learning for Text-to-SQL with Automated Interpretable Critiques
- 构建生成式评判模型,自动生成查询专属评估标准
- 通过渐进探索策略提升强化学习中的奖励密度,显著改善性能
- 适合需要高精度、低成本评估的文本转SQL研究者
文本转SQL是自然语言处理中将自然语言查询转换为可执行SQL的关键任务。尽管近年来进展显著,但现有训练与评估中的奖励机制仍是瓶颈。当前方法高度依赖昂贵的人工标注黄金SQL,且多数强化学习方法仅使用最终执行结果作为奖励信号,缺乏对结构和语义错误的细粒度监督。为此,我们提出RuCo-C,一种无需人工干预的生成式评判模型,可自动生成查询特定的评估标准,并提供可解释的批评。该框架通过“渐进探索”策略,在强化学习过程中注入密集奖励反馈,动态调整奖励以提升模型表现。大量实验表明,RuCo-C在文本转SQL评估中优于现有方法,取得显著性能提升。
原文摘要 · Abstract (English)
Text-to-SQL, a pivotal natural language processing (NLP) task that converts textual queries into executable SQL, has seen substantial progress in recent years. However, existing evaluation and reward mechanisms used to train and assess the text-to-SQL models remain a critical bottleneck. Current approaches heavily rely on manually annotated gold SQL queries, which are costly to produce and impractical for large-scale evaluation. More importantly, most reinforcement learning (RL) methods in text-to-SQL leverage only the final binary execution outcome as the reward signal, a coarse-grained supervision that overlooks detailed structural and semantic errors from the perspective of rubrics. To address these challenges, we propose RuCo-C, a novel generative judge model for fine-grained, query-specific automatic evaluation using interpretable critiques without human intervention. Our framework first automatically generates query-specific evaluation rubrics for human-free annotation, linking them to interpretable critiques. Subsequently, it integrates densified reward feedback through a "progressive exploration" strategy during the RL training process, which dynamically adjusts the rewards to enhance the model's performance. Comprehensive experiments demonstrate that RuCo-C outperforms existing methods in text-to-SQL evaluation, yielding significant performance gains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。