arXiv:2510.23284cs.CL2025-10

通过自动数据修复与多模型协作训练,提升文本转SQL的准确率。

DCMM-SQL: Automated Data-Centric Pipeline and Multi-Model Collaboration Training for Text-to-SQL Model

  • 自动修复训练数据错误并增强错误样本以提升质量。
  • 多模型协作训练使不同模型互补,显著提高准确率。
  • 适合追求高精度文本转SQL系统的开发者与研究者。

自ChatGPT发布以来,文本转SQL任务取得了显著进展。其中,基于代理的框架被广泛应用,但数据驱动策略在该任务中的影响尚未深入探索。本文系统设计了一套全自动的数据中心化流水线,包括自适应数据修复,可自动发现并修正训练数据中的错误;以及错误数据增强,针对初始模型预测出的错误数据进行扩散和强化。同时,提出多模型协作训练机制,让多个模型使用不同增强数据训练,具备差异化能力并协同互补,因为单个微调模型的能力有限。此外,采用集成策略融合多个模型能力,用于解决多选题,进一步提升文本转SQL的准确性。实验结果与消融研究验证了数据驱动流水线及多模型(MM)交互迭代策略的有效性,在轻量级文本转SQL模型(参数量低于70B)中取得第一名。

原文摘要 · Abstract (English)

Text-to-SQL tasks have gained attractive improvements since the release of ChatGPT. Among them, agent-based frameworks have been widely used in this field. However, the impact of data-centric strategies on text-to-SQL tasks has rarely been explored. In this paper, we systemically design a fully automated data-centric pipeline for text-to-SQL tasks, including \emph{adaptive data repair}, which can automatically find and fix errors in the training dataset; and \emph{error data augmentation}, where we specifically diffuse and enhance erroneous data predicted by the initially trained models. Meanwhile, we propose a Multi-Model collaboration training schema, aiming to train multiple models with different augmented data, enabling them to possess distinct capabilities and work together to complement each other, because it has been found that the capability of a single fine-tuned model is very limited. Furthermore, we utilize an ensemble strategy to integrate the capabilities of multiple models to solve a multiple-choice question, aiming to further improve the accuracy of text-to-SQL tasks. The experiment results and ablation study have demonstrated the effectiveness of data-centric pipeline and Multi-Model(MM) interactive iterative strategies, achieving first place in lightweight text-to-SQL models (within 70B).

文本转SQL数据增强多模型协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。