arXiv:2502.17715cs.CLcs.AI2025-02被引 4

用大模型生成问答补全,让小模型学会提更丰富的问题。

Bridging Information Gaps with Comprehensive Answers: Improving the Diversity and Informativeness of Follow-Up Questions

  • 大模型先生成完整答案,对比找出信息缺口
  • 补全后的问题集让小模型提问多样性提升40%以上
  • 适合资源有限的对话系统开发者使用

对话系统生成多样且能揭示缺失信息的后续问题仍具挑战性,尤其在小型本地部署模型上。为此,我们设计了一种基于信息缺口的知识蒸馏流程:由教师大模型生成完整回答,与初始回答对比识别信息缺口,并据此生成填补缺口的后续问题。利用该流程,我们将现有FollowupQG数据集扩充十倍。随后在扩充数据上微调小型学生模型以学习教师知识。实验显示,经微调的学生模型在信息量和多样性上显著优于原始数据训练的版本。结果表明,该流程模拟人类信息探索认知过程,为从顶尖大模型向小模型高效传递知识提供了有效路径,使资源受限的对话系统能生成更丰富、更有信息量的后续问题。

原文摘要 · Abstract (English)

Generating diverse follow-up questions that uncover missing information remains challenging for conversational agents, particularly when they run on small, locally hosted models. To address this, we develop an information-gap-driven knowledge distillation pipeline in which a teacher LLM generates a comprehensive answer, contrasts it with the initial answer to identify information gaps, and formulates gap-bridging follow-up questions. Using this pipeline, we augment the existing FollowupQG dataset tenfold. We then fine-tune smaller student models on the augmented dataset to distill the teacher's knowledge. Experiments with selected teacher-student model pairs show that fine-tuned students achieve significantly higher informativeness and diversity than variations trained on the original dataset. These findings indicate that our pipeline, which mirrors the human cognitive process of information seeking, provides an efficient distillation channel from state-of-the-art LLMs to smaller models, enabling resource-constrained conversational systems to generate more diverse and informative follow-up questions.

对话系统知识蒸馏问答生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。