arXiv:2508.12726cs.CL2025-08中稿 · ICLR被引 5

用设计逻辑生成跨学科复杂推理题,提升大模型多领域推理能力。

DESIGNER: Design-Logic-Guided Multidisciplinary Data Synthesis for LLM Reasoning

  • 基于设计逻辑的两阶段生成机制,从原始文本合成新问题。
  • 构建两个超大规模数据集,涵盖75个学科,总量超460万道题。
  • 仅用自建数据微调,超越官方最终版模型的推理表现。

大语言模型在多数语言任务上表现优异,但在跨学科的多步推理方面仍存挑战。现有推理数据集普遍存在学科覆盖窄、推理深度不足、多样性差及问题生成缺乏指导原则等问题。本文提出 DESIGNER:一种基于设计逻辑引导的多学科推理数据合成框架,利用大量自然存在的原始文档生成跨学科复杂问题。核心思想是‘设计逻辑’——一种可复用的元知识,体现专家将知识转化为复杂考题的结构化过程,使大模型能从全新文本中生成具备相同复杂推理模式的问题,并对难度、多样性与题型实现显式控制。我们通过大模型逆向解析并抽象出超过12万条设计逻辑。采用两阶段检索-生成机制,将这些设计逻辑与原始语料匹配,合成两个大规模推理数据集:DLR-Book(304万道题,来自书籍语料)和DLR-Web(166万道题,来自网络语料)。数据分析表明,合成问题在难度与多样性上均优于基线数据集。在 Qwen3 与 Llama3 上使用本数据进行监督微调,显著提升多学科推理性能,甚至超越官方经过完整后训练的最终版本模型。

原文摘要 · Abstract (English)

Large language models (LLMs) perform strongly on many language tasks but still struggle with complex multi-step reasoning across disciplines. Existing reasoning datasets often lack disciplinary breadth, reasoning depth, and diversity, as well as guiding principles for question synthesis. We propose DESIGNER: a DESIGN-logic-guidEd Reasoning data synthesis pipeline that leverages naturally available, extensive raw documents to generate multidisciplinary questions. The central insight is the notion of Design Logic, a form of reusable meta-knowledge that encapsulates the structured process human experts use to transform knowledge into complex exam questions, enabling LLMs to generate new questions with the same complex reasoning patterns from entirely different source texts with explicit control over difficulty, diversity, and question types. We use LLMs to reverse-engineer and abstract over 120,000 Design Logics from existing questions across various disciplines. By designing a two-stage retrieve-and-generate mechanism to match these Design Logics with raw corpus, we synthesized two large-scale reasoning datasets that span 75 disciplines: DLR-Book (3.04 million questions from the book corpus) and DLR-Web (1.66 million questions from the web corpus). Data analysis indicates that the questions synthesized by our method exhibit greater difficulty and diversity compared to those in the baseline datasets. Supervised fine-tuning (SFT) on Qwen3 and Llama3 with our data substantially improves multidisciplinary reasoning and outperforms baseline datasets. Notably, by applying SFT on the base versions of these models using only our data, we even surpass their official final models that have undergone the full post-training.

大模型推理数据合成多学科设计逻辑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。