让大模型学会识别无法回答的问题,提升对话可信度。
Contextual Candor: Enhancing LLM Trustworthiness Through Hierarchical Unanswerability Detection
- 通过分级标注数据训练模型,自动判断问题是否可答。
- 在多个层级检测准确率显著提升,拒绝回答更恰当。
- 适合需要高可信度对话的场景,如医疗、法律咨询。
大型语言模型在对话式AI系统中的广泛应用已改变信息获取方式,但其生成无事实依据或虚构内容的倾向仍是影响可信度和普及的关键障碍。本文提出强化不可答性学习(RUL),一种新型混合训练范式,使大模型具备精准识别不可答问题并生成恰当回应的能力。与依赖外部分类器或简单提示的传统方法不同,RUL将判别式不可答预测头与生成核心结合,并采用多阶段学习策略。包括在新构建的丰富标注数据集Enhanced-CAsT-Answerability(ECA)上进行监督微调,该数据集包含层级化答案可答标签及真实拒绝响应;关键在于后续引入人类反馈强化学习(RLHF)阶段,以优化拒绝回应的细腻度、帮助性和信息量。大量实验表明,RUL在句子、段落及排序等多个层级的不可答检测中表现卓越,显著提升对不可答问题的恰当拒绝率,同时在可答问题上保持强性能。人工评估进一步证实其有效性,感知帮助性与可信度明显提升,为更可靠、以用户为中心的对话式AI铺平道路。
原文摘要 · Abstract (English)
The pervasive deployment of large language models (LLMs) in conversational AI systems has revolutionized information access, yet their propensity for generating factually unsupported or hallucinated responses remains a critical impediment to trustworthiness and widespread adoption. This paper introduces Reinforced Unanswerability Learning (RUL), a novel hybrid training paradigm designed to imbue LLMs with the intrinsic capability to accurately detect unanswerable questions and generate reliably appropriate responses. Unlike conventional approaches that rely on external classifiers or simple prompting, RUL integrates a discriminative unanswerability prediction head with the LLM's generative core, guided by a multi-stage learning strategy. This includes supervised fine-tuning on a novel, richly annotated dataset, Enhanced-CAsT-Answerability (ECA), which features hierarchical answerability labels and ground-truth refusal responses. Crucially, RUL incorporates a subsequent reinforcement learning with human feedback (RLHF) phase to refine the nuance, helpfulness, and informativeness of refusal responses. Extensive experiments demonstrate RUL's superior performance, achieving significantly higher accuracy in unanswerability detection across sentence, paragraph, and ranking levels, and substantially increasing the generation of appropriate refusals for unanswerable queries, alongside strong performance on answerable questions. Human evaluations further corroborate RUL's effectiveness, highlighting a marked improvement in perceived helpfulness and trustworthiness, ultimately paving the way for more reliable and user-centric conversational AI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。