arXiv:2509.10818cs.AIcs.HC2025-09被引 1

用专家思维模型减少大模型幻觉,让其在无文本依据时仍能正确决策。

LLM Enhancement with Domain Expert Mental Model to Reduce LLM Hallucination with Causal Prompt Engineering

  • 将专家隐性知识转化为可编码的决策逻辑,通过因果提示工程输入大模型。
  • 在多个领域验证,对隐性知识缺失场景的错误率可逼近100%的检测能力。
  • 首次实现对完全隐性知识下大模型幻觉的正式度量,适合高风险决策场景。

当关键决策依赖于未被书面记录的知识时,大模型的幻觉并非源于检索失败,而是模型本身缺失。RAG与知识图谱方法存在结构性局限,无法补足从未被记录的内容。本文将此问题重构为模型发现任务,提出因果提示工程框架,通过挖掘并编码领域专家的决策逻辑(专家心智模型,EMM),以原则性方式向大模型提供其无法通过检索获得的知识。该框架基于单调布尔函数与k值函数理论,首次形式化了三个此前在新领域中未开发的辅助流程:因子构建、因子单调化与保持单调性的层次结构化。由此形成四步可计算的EMM构建算法,将初始需评估的组合数从百万级降至人类可管理的有限集。该框架还首次实现了对完全隐性专家知识下大模型幻觉的正式度量。分析显示,在专家与模型存在潜在不匹配时,真阳性条件错误率可接近100%,而现有评估方法难以察觉。该方法在资助提案评审、网络安全设计与临床诊断中得到验证。

原文摘要 · Abstract (English)

When consequential decisions depend on knowledge that exists nowhere in writing, LLMs hallucinate not from retrieval failure but from model absence. RAG and knowledge-graph methods share a structural ceiling. They cannot supply what has never been recorded. This paper reconceptualizes that failure as a model discovery problem. The proposed causal prompt engineering framework discovers and encodes a decision logic of a domain expert as an Expert Mental Model (EMM), providing it as principled input to LLM reasoning supplying what no retrieval method can. The framework is grounded in the theory of monotone Boolean and k-valued functions. A key technical contribution is the formalization of three LLM assisted prerequisite processes previously undeveloped for novel domains: factor formulation, factor monotonization, and monotonicity preserving hierarchical structuring. These enable a four step EMM construction algorithm that reduces elicitation from millions of combinations to a tractable, formally bounded set manageable by humans. The framework also enables, for the first time, formal measurement of LLM hallucination when expert knowledge is entirely tacit. Analysis shows conditional error rates on true positives can approach 100% for plausible LLM-expert mismatches invisible to prior evaluation methods. The approach is validated across grant proposal evaluation, cybersecurity design, and clinical diagnosis.

大模型幻觉专家模型因果提示决策推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。