arXiv:2508.01317cs.CL2025-08ACL被引 3

用知识点图谱生成多样化高质量问答数据,提升大模型训练效果。

LinkQA: Synthesizing Diverse QA from Multiple Seeds Strongly Linked by Knowledge Points

  • 基于知识点图谱,从多源问题中生成强关联的多样化问答。
  • 合成500亿词元的LinkQA数据集,使大模型在多项测试中提升11.51%。
  • 支持灵活控制学科与难度分布,适合大模型持续预训练使用。

大型语言模型的发展受限于高质量、多样化的训练数据稀缺。为此,我们提出LinkSyn——一种基于知识点(KP)图谱的合成框架,可在保证知识点覆盖率与流行度平衡的前提下,灵活调控学科与难度分布。LinkSyn从问答种子数据中提取知识点,构建知识点图谱,并通过图遍历从多个种子中合成强关联的多样化问答数据。具体包括:(1) 引入知识分布价值函数,引导路径采样概率调整,实现覆盖与流行度平衡;(2) 基于DeepSeek-R1的扩散式合成,利用路径上密集逻辑关联的多源种子;(3) 通过灵活调节难度,增强特定学科的高难度问答。经执行,生成了包含500亿词元的LinkQA多学科问答数据集。在Llama-3 8B上的实验表明,持续预训练使用LinkQA后,在MMLU和CMMLU上平均提升11.51%,达到新SOTA。LinkQA在不同模型规模和初始计算量下均稳定提升性能。

原文摘要 · Abstract (English)

The advancement of large language models (LLMs) struggles with the scarcity of high-quality, diverse training data. To address this limitation, we propose LinkSyn, a novel knowledge point (KP) graph-based synthesis framework that enables flexible control over discipline and difficulty distributions while balancing KP coverage and popularity. LinkSyn extracts KPs from question-answering (QA) seed data and constructs a KP graph to synthesize diverse QA data from multiple seeds strongly linked by KPs and sampled from graph walks. Specifically, LinkSyn incorporates (1) a knowledge distribution value function to guide the adjustment of path sampling probability and balance KP coverage and popularity during graph walks; (2) diffusion-based synthesis via DeepSeek-R1 by leveraging multiple seeds with dense logical associations along each path; and (3) high-difficulty QA enhancement within given disciplines by flexible difficulty adjustments. By executing LinkSyn, we synthesize LinkQA, a diverse multi-disciplinary QA dataset with 50B tokens. Extensive experiments on Llama-3 8B demonstrate that continual pre-training with LinkQA yields an average improvement of $\mathbf{11.51\%}$ on MMLU and CMMLU, establishing new SOTA results. LinkQA consistently enhances performance across model size and initial FLOPs scales.

知识图谱数据合成大模型训练问答系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。