通过分析查询骨架提升文本转查询模型泛化能力
Skeletons Matter: Dynamic Data Augmentation for Text-to-Query
- 以查询骨架为优化目标,动态生成针对性训练数据
- 仅用少量合成数据即达最先进性能
- 适合多查询语言场景下的统一建模研究
将自然语言问题转化为查询语言的任务长期是语义解析的核心。尽管大语言模型推动了该领域进展,但现有方法多聚焦单一查询语言,泛化能力受限。本文正式定义文本转查询任务范式,统一多种查询语言的语义解析任务。识别出查询骨架是各类任务的共性优化目标,提出一种通用动态数据增强框架,可诊断模型在处理骨架时的具体弱点,并生成针对性训练数据。在四个文本转查询基准上的实验表明,该方法仅需少量合成数据即可达到当前最优性能,凸显其高效性与通用性,为文本转查询任务的统一研究奠定基础。代码已开源。
原文摘要 · Abstract (English)
The task of translating natural language questions into query languages has long been a central focus in semantic parsing. Recent advancements in Large Language Models (LLMs) have significantly accelerated progress in this field. However, existing studies typically focus on a single query language, resulting in methods with limited generalizability across different languages. In this paper, we formally define the Text-to-Query task paradigm, unifying semantic parsing tasks across various query languages. We identify query skeletons as a shared optimization target of Text-to-Query tasks, and propose a general dynamic data augmentation framework that explicitly diagnoses model-specific weaknesses in handling these skeletons to synthesize targeted training data. Experiments on four Text-to-Query benchmarks demonstrate that our method achieves state-of-the-art performance using only a small amount of synthesized data, highlighting the efficiency and generality of our approach and laying a solid foundation for unified research on Text-to-Query tasks. We release our code at https://github.com/jjjycaptain/Skeletron.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。