测试大模型能否真正理解用户意图,而非仅依赖文字表面。
Measuring Intent Comprehension in LLMs
- 通过分解输出差异来源,量化意图理解能力
- 大模型更倾向将输出差异归因于意图而非表达方式
- 适合关注模型泛化与可靠性的人参考
人们判断大语言模型(LLMs)交互是否成功,取决于输出是否符合真实意图,而非输入文字本身。但现有模型仅基于文本预测下一个词,未学习深层意图。由于文字是意图的不完美表达,训练数据中语义与目标的关联可能断裂,导致模型过度依赖表面表达,对语义相同但表述不同的提示反应不一致。因此评估模型是否能稳定理解意图至关重要,尤其在高风险场景中。本文提出一个评估框架:衡量模型在语义等价提示下是否产生一致输出,而在意图不同时能否区分。该方法通过方差分解,将输出变化分为意图、表达风格和模型不确定性三部分。理想情况下,输出差异应主要由意图驱动。我们在五种LLaMA和Gemma模型上验证发现,模型越大,越倾向于将方差归因于意图,但提升幅度不均且有限。这提示需从仅关注准确率转向直接评估意图理解的语义诊断。
原文摘要 · Abstract (English)
People judge interactions with large language models (LLMs) as successful when outputs match what they want, not what they type. Yet LLMs are trained to predict the next token solely from text input, not underlying intent. Because written language is an imperfect proxy for intent, and correlations between phrasing and desired outcomes can break down in training data, models that rely too heavily on surface cues may respond inconsistently to semantically equivalent prompts. This makes it essential to evaluate whether LLMs can reliably infer user intent-especially in high-stakes settings where robustness and generalization are critical. We introduce a formal framework for assessing intent comprehension in LLMs: whether a model demonstrates robust understanding of user intent by producing consistent outputs across semantically equivalent prompts while differentiating between prompts with distinct intents. Our evaluation approach is based on a variance decomposition of model responses into three components: variability due to user intent, user articulation, and model uncertainty. Models that understand what users want, and are not overly sensitive to textual cues, should attribute most output variance to intent differences, rather than articulation style. Applying this framework across diverse domains, we find that, within the five LLaMA and Gemma models we evaluate, larger models typically assign a greater share of variance to intent, indicating stronger comprehension of intent, although gains are uneven and often modest with increasing model size. These results motivate moving beyond accuracy-only benchmarks toward semantic diagnostics that directly assess whether models understand what users intend.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。