arXiv:2604.06603cs.CLcs.AI2026-04

用科学知识约束大模型生成,减少幻觉,提升可靠性。

Scientific Knowledge-driven Decoding Constraints Improving the Reliability of LLMs

论文配图:Scientific Knowledge-driven Decoding Constraints Improving the Reliability of LLMs
图 1 · 摘自论文原文
  • 将科学理论转化为多层标准化规则,约束模型输出
  • 在工业配方、肿瘤诊断等任务中平均准确率提升12%
  • 适合需要高可靠性的科研与医疗领域应用

大语言模型虽具备强大知识储备和解题能力,但仍面临严重幻觉问题,限制实际应用。尽管科学理论和规则能有效指导人类操作,但大模型在训练或提示中并未充分利用这些高度凝练的知识。为此,我们提出SciDC,一种将学科特定知识与强约束结合的生成方法。通过使用强大的大模型自动将灵活知识转化为多层级、标准化规则,构建可扩展的框架,有效约束模型在专业领域的生成行为。在工业配方设计、临床肿瘤诊断和逆合成路径规划等科学任务上的实验表明,该方法平均准确率较原始生成提升12%。我们进一步探讨了大模型自动归纳高度凝练知识的潜力,展望其在加速整体科研进程中的实际应用前景。论文代码已开源(https://github.com/Maotian-Ma/SciDC)。

原文摘要 · Abstract (English)

Large language models (LLMs) have shown strong knowledge reserves and task-solving capabilities, but still face the challenge of severe hallucination, hindering their practical application. Though scientific theories and rules can efficiently direct the behaviors of human manipulators, LLMs still do not utilize these highly-condensed knowledge sufficiently through training or prompting. To address this issue, we propose \textbf{SciDC}, an LLM generation method that integrate subject-specific knowledge with strong constraints. By adopting strong LLMs to automatically convert flexible knowledge into multi-layered, standardized rules, we build an extensible framework to effectively constrain the model generation on domain tasks. Experiments on scientific tasks including industrial formulation design, clinical tumor diagnosis and retrosynthesis planning, consistently demonstrate the effectiveness of our method, achieving a 12\% accuracy improvement on average compared with vanilla generation. We further discuss the potential of LLMs in automatically inductively summarizing highly-condensed knowledge, looking ahead to practical solutions for accelerating the overall scientific research process. All the code of this paper can be obtained (https://github.com/Maotian-Ma/SciDC).

大模型科学推理幻觉抑制知识约束

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。