用双重机制减少大模型胡说,效果比单一方法更好。
Hallucination as output-boundary misclassification: a composite abstention architecture for language models
- 结合指令拒答与结构化回避门,动态判断输出是否可信。
- 在50个测试项中,复合架构使幻觉率降低,准确率保持高位。
- 适合需要高可靠性生成的场景,如医疗、法律问答。
大语言模型常产生无依据的陈述。本文将其视为输出边界上的误分类,即内部生成内容被错误地当作有证据支持。为此提出复合干预策略:结合指令引导拒绝与结构化回避门。该门通过三个黑盒信号(自一致性、改写稳定性、引用覆盖度)计算支持缺陷得分St,当超过阈值时阻断输出。在50个测试项、五种认知情境、三种模型上的评估显示,单独使用指令提示虽显著降低幻觉,但对可回答问题过度回避,且GPT-3.5-turbo仍有残留幻觉;结构化门能保持可回答项的准确率,但对矛盾证据下的自信编造未能识别。复合架构在整体准确率和低幻觉间取得平衡,同时继承部分指令组件的过度回避。100项无上下文压力测试(来自TruthfulQA)进一步表明,结构化门提供与能力无关的最低回避基线。二者失败模式互补,表明有效幻觉控制需融合双机制。
原文摘要 · Abstract (English)
Large language models often produce unsupported claims. We frame this as a misclassification error at the output boundary, where internally generated completions are emitted as if they were grounded in evidence. This motivates a composite intervention that combines instruction-based refusal with a structural abstention gate. The gate computes a support deficit score, St, from three black-box signals: self-consistency (At), paraphrase stability (Pt), and citation coverage (Ct), and blocks output when St exceeds a threshold. In a controlled evaluation across 50 items, five epistemic regimes, and three models, neither mechanism alone was sufficient. Instruction-only prompting reduced hallucination sharply, but still showed over-cautious abstention on answerable items and residual hallucination for GPT-3.5-turbo. The structural gate preserved answerable accuracy across models but missed confident confabulation on conflicting-evidence items. The composite architecture achieved high overall accuracy with low hallucination, while also inheriting some over-abstention from the instruction component. A supplementary 100-item no-context stress test derived from TruthfulQA showed that structural gating provides a capability-independent abstention floor. Overall, instruction-based refusal and structural gating show complementary failure modes, which suggests that effective hallucination control benefits from combining both mechanisms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。