arXiv:2410.03197cs.CL2024-10EMNLP被引 5

无需目标语言数据,用小模型跨语言生成问题。

Cross-lingual Transfer for Automatic Question Generation by Learning Interrogative Structures in Target Languages

  • 仅用英语数据学习疑问句结构,迁移至其他语言。
  • 跨语言生成效果接近GPT-3.5-turbo,且参数量少。
  • 适合资源匮乏语言的问答数据增强,无需额外训练。

自动问题生成(QG)广泛应用于问答语料扩充、聊天机器人优化和教育材料开发。然而现有数据集主要集中于英语,导致其他语言数据严重不足。跨语言迁移问题生成(XLT-QG)通过利用高资源语言模型生成低资源语言问题来弥补这一缺陷。本文提出一种简单高效的XLT-QG方法,无需目标语言的单语、平行或标注数据,仅依赖小型语言模型。模型在英语QA数据上训练,从少量问题样本中学习疑问句结构,并将其迁移到目标语言生成问题。实验表明,该方法优于多个XLT-QG基线,性能接近GPT-3.5-turbo,在多种语言上表现良好。此外,生成的合成数据对多语言QA模型训练具有显著提升作用。相比大模型,本方法参数量极低,且无需为目标语言再训练,为多语言QG与QA任务提供高效解决方案。

原文摘要 · Abstract (English)

Automatic question generation (QG) serves a wide range of purposes, such as augmenting question-answering (QA) corpora, enhancing chatbot systems, and developing educational materials. Despite its importance, most existing datasets predominantly focus on English, resulting in a considerable gap in data availability for other languages. Cross-lingual transfer for QG (XLT-QG) addresses this limitation by allowing models trained on high-resource language datasets to generate questions in low-resource languages. In this paper, we propose a simple and efficient XLT-QG method that operates without the need for monolingual, parallel, or labeled data in the target language, utilizing a small language model. Our model, trained solely on English QA datasets, learns interrogative structures from a limited set of question exemplars, which are then applied to generate questions in the target language. Experimental results show that our method outperforms several XLT-QG baselines and achieves performance comparable to GPT-3.5-turbo across different languages. Additionally, the synthetic data generated by our model proves beneficial for training multilingual QA models. With significantly fewer parameters than large language models and without requiring additional training for target languages, our approach offers an effective solution for QG and QA tasks across various languages.

跨语言问题生成小模型数据增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。