arXiv:2509.10708cs.CL2025-09被引 2

用检索增强生成领域指令数据,提升大模型专业能力

SearchInstruct: Enhancing Domain Adaptation via Retrieval-Based Instruction Dataset Creation

  • 基于少量人工问题,用大模型扩展并检索领域资源生成答案
  • 生成数据显著提升领域微调效果,模型表现明显优于基线
  • 适合需要快速构建专业领域数据的开发者和研究者

监督微调(SFT)对训练大语言模型至关重要,能显著提升模型遵循指令和上下文学习的能力。然而,由于领域特性和数据稀缺,为特定领域定制高质量训练数据仍具挑战。本文提出SearchInstruct,一种专为SFT构建高质量指令数据集的新方法。该方法从少量人工撰写的领域相关问题出发,利用大语言模型系统性地扩展问题,并动态检索领域相关资源,为每个扩展后的问题生成准确且上下文相关的答案。实验表明,SearchInstruct有效提升了SFT数据集的多样性和质量,显著改善了大模型在专业领域的性能。此外,该方法还可用于模型编辑任务,实现对现有模型的高效更新。为促进可复现性和社区应用,我们公开了完整实现、生成的指令-响应对及源代码:[https://github.com/mostafaamiri/SearchInstruct](https://github.com/mostafaamiri/SearchInstruct)

原文摘要 · Abstract (English)

Supervised Fine-Tuning (SFT) is essential for training large language models (LLMs), significantly enhancing critical capabilities such as instruction following and in-context learning. Nevertheless, creating suitable training datasets tailored for specific domains remains challenging due to unique domain constraints and data scarcity. In this paper, we propose SearchInstruct, an innovative method explicitly designed to construct high quality instruction datasets for SFT. Our approach begins with a limited set of domain specific, human generated questions, which are systematically expanded using a large language model. Subsequently, domain relevant resources are dynamically retrieved to generate accurate and contextually appropriate answers for each augmented question. Experimental evaluation demonstrates that SearchInstruct enhances both the diversity and quality of SFT datasets, leading to measurable improvements in LLM performance within specialized domains. Additionally, we show that beyond dataset generation, the proposed method can also effectively facilitate tasks such as model editing, enabling efficient updates to existing models. To facilitate reproducibility and community adoption, we provide full implementation details, the complete set of generated instruction response pairs, and the source code in a publicly accessible Git repository: [https://github.com/mostafaamiri/SearchInstruct](https://github.com/mostafaamiri/SearchInstruct)

指令微调领域适应数据生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。