让大模型主动列出模糊请求的多种解释,避免误答风险。
Reasoning about Intent for Ambiguous Requests
- 用强化学习训练模型,同时优化覆盖度和准确率
- 在对话问答和语义解析任务中,有效识别更多正确解释
- 输出结构化结果,适合需要透明决策的场景
大型语言模型在处理模糊请求时,常默认选择一种解释,导致用户困惑并引发安全风险。本文提出生成单一结构化响应,列举模糊请求的各种可能解释及其对应答案。模型通过强化学习训练,采用双目标奖励:在模糊输入上最大化有效解释的召回率,在明确输入上提高精确度以抑制错误推断。训练仅需每个输入的多个有效答案作为监督信号,无需澄清问题或显式标注解释。在对话问答和语义解析任务上的实验表明,该方法比基线方法更全面覆盖有效答案。人工评估确认预测解释具有意义,并能合理说明对应答案。该方法提升透明性,单次生成即可覆盖所有解释,避免多轮交互,且结构化输出利于下游应用。
原文摘要 · Abstract (English)
Large language models often respond to ambiguous requests by implicitly committing to one interpretation, frustrating users and creating safety risks when that interpretation is wrong. We propose generating a single structured response that enumerates the different ways an ambiguous request can be interpreted, each coupled with a corresponding answer. Our models are trained with reinforcement learning using a dual reward objective: recall on ambiguous inputs to maximise coverage of valid interpretations, and precision on unambiguous ones to suppress spurious alternatives. Training requires only multiple valid answers per input as supervision, no clarification questions or explicit interpretations are needed. Experiments on conversational question answering and semantic parsing demonstrate that our method achieves higher coverage of valid answers than baseline approaches. Human evaluation confirms that predicted interpretations are meaningful and explain their corresponding answers. Our approach promotes transparency with explicit interpretations, avoids additional interaction rounds by producing all interpretations in a single generation, and supports downstream applications through its structured output format.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。