arXiv:2601.19588cs.LGcs.AI2026-01

让大模型自己发现错误,分步教学生推理,无需人工标注。

From Atoms to Chains: Divergence-Guided Reasoning Curriculum for Unlabeled LLM Domain Adaptation

  • 从师生分歧中提取原子问题,动态生成教学路径。
  • 在医疗领域使15亿参数模型性能提升7.76%。
  • 适合无标注数据场景下的大模型领域适配。

在无人工标注数据的情况下,将大语言模型(LLM)适配到专业领域是一项关键但艰巨的挑战。现有知识蒸馏方法常演变为粗粒度模仿,导致学生模型低效地应对自身弱点,并可能继承教师模型的推理缺陷。这暴露了一个核心教育难题:当教师本身并非完美专家时,如何设计可靠的教学课程?本文提出分裂引导推理课程(DGRC),其核心洞见是:尽管大模型在复杂整体推理中可能出错,但在聚焦的原子子问题上往往保持高保真度。基于此,DGRC通过分析师生推理路径的分歧,动态构建两种互补的课程。当师生结果冲突时,教师会进行诊断分析:分别解析两条推理路径,提炼出针对分歧点的原子问题,并自问自答生成高置信度的原子问答对。这些问答对兼具双重作用:(1) 提供原子级课程以修复学生知识漏洞;(2) 作为事实标准过滤教师原始推理链,生成经验证的思维链课程,指导学生如何整合原子知识形成完整推理。在医学与法律领域的实验表明,该框架对不同规模的学生模型均有效。尤其在医学领域,1.5B参数学生模型相较强基线实现7.76%的相对提升。

原文摘要 · Abstract (English)

Adapting Large Language Models (LLMs) to specialized domains without human-annotated data is a crucial yet formidable challenge. Widely adopted knowledge distillation methods often devolve into coarse-grained mimicry, where the student model inefficiently targets its own weaknesses and risks inheriting the teacher's reasoning flaws. This exposes a critical pedagogical dilemma: how to devise a reliable curriculum when the teacher itself is not an infallible expert. Our work resolves this by capitalizing on a key insight: while LLMs may exhibit fallibility in complex, holistic reasoning, they often exhibit high fidelity on focused, atomic sub-problems. Based on this, we propose Divergence-Guided Reasoning Curriculum (DGRC), which constructs a learning path from atomic knowledge to reasoning chains by dynamically deriving two complementary curricula from disagreements in reasoning pathways. When a student and teacher produce conflicting results, DGRC directs the teacher to perform a diagnostic analysis: it analyzes both reasoning paths to formulate atomic queries that target the specific points of divergence, and then self-answers these queries to create high-confidence atomic question-answer pairs. These pairs then serve a dual purpose: (1) providing an atomic curriculum to rectify the student's knowledge gaps, and (2) serving as factual criteria to filter the teacher's original reasoning chains, yielding a verified CoT curriculum that teaches the student how to integrate atomic knowledge into complete reasoning paths. Experiments across the medical and legal domains on student models of various sizes demonstrate the effectiveness of our DGRC framework. Notably, our method achieves a 7.76% relative improvement for the 1.5B student model in the medical domain over strong unlabeled baseline.

大模型无监督学习知识蒸馏推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。