用反事实数据循环训练诊断大模型,提升推理准确性。
DiagLoop: A Counterfactual Data Flywheel with Stage-Localized Reinforcement for Diagnostic LLMs

- 构建反事实数据飞轮,自动生成训练样本。
- 8个工业系统正确率提升11.6点,5类疾病提升5.5点。
- 无需人工标注,适合部署于缺乏真实案例的场景。
因果诊断模型需解释结论如何由证据推导而来,以指导维修与治疗。但严重病例稀少,病历通常不包含推理路径,且数据难以跨配置迁移,限制了本地化部署。本文提出DiagLoop,一种反事实数据飞轮机制,将每类故障机制的物理关系或临床指南编码一次,转化为超越实际案例的训练监督信号。仅训练阶段的教师通过改变原因、上下文和观测值生成反事实世界,独立的混合检查器仅允许有效世界通过。学生模型进行症状抽象、因果链构建与根本原因归因。阶段性标准识别其最早失败点。对于非终止性失败,有限修复探测下游能力,弱点图谱指导后续数据生成。阶段局部强化学习仅更新模型生成的延续部分,同时重放与保存机制减少遗忘。相同标准贯穿准入、归因、奖励与再生过程,检查者与生成者分离。仅使用合成场景,无需案例级专家推理标注,8B模型在严格路径正确率上超越最强基线。八类工业系统提升11.6点,十类疾病提升5.5点;相较紊乱路由控制分别提升3.9和2.3点。模型在两类领域均超过评估的专有参考模型,即使后者获得少量示例或上下文说明。
原文摘要 · Abstract (English)
Causal diagnostic models must explain how conclusions follow from evidence because diagnoses guide repairs and treatments. Yet serious cases are scarce, records rarely contain reasoning paths, and data transfer poorly across configurations, complicating local deployment. We present DiagLoop, a counterfactual data flywheel that converts codified physical relations or clinical guidelines, authored once per mechanism family, into training supervision beyond recorded cases. A training-only teacher proposes counterfactual worlds by varying causes, contexts, and observations, while an independent hybrid checker admits only valid worlds. The student reasons through symptom abstraction, causal-chain construction, and root-cause attribution. Stage-specific criteria identify its earliest failure. For nonterminal failures, a bounded repair probes downstream competence, and the resulting weakness profile guides subsequent data generation. Stage-localized reinforcement learning updates only the model-generated continuation, while replay and preservation reduce forgetting. The same criteria govern admission, attribution, reward, and regeneration through checks separate from the proposer. Using only synthesized scenarios and no case-level expert reasoning annotations, the resulting 8B model improves strict path correctness over the strongest conventional baseline. Gains are 11.6 points across eight industrial systems and 5.5 points across ten disease categories. Gains over a deranged-routing control are 3.9 and 2.3 points, respectively. The model also exceeds the evaluated proprietary references in both domains, even when they receive few-shot examples or the specification in context.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。