教用户识别大模型的错误模式,能有效减少盲目依赖。
Teaching People LLM's Errors and Getting it Right
- 通过元标签分组发现大模型在特定任务上的失败模式
- 实验证明存在可识别的错误模式,且能被用户学习
- 新评估指标更准确衡量教学效果,适合指导实际应用
人们在不该使用大语言模型(LLM)时仍会依赖它,部分原因在于误以为其在复杂任务上表现好,就必然胜任基础任务如简单算术。已有研究尝试通过聚类实例嵌入来识别易错区域,并自动描述其中规律以教育用户。然而该方法成效有限。本文分析其原因:首先验证失败模式是否存在——对两个数据集按元标签分组并评估模型表现,发现确实存在误差率高且规模可观的元标签组,即真实存在的失败模式;其次测试提示和嵌入方法能否有效识别这些模式,结果不一,解释了先前方法失效的原因;最后重新审视教学有效性度量标准,提出应评估用户利用失败模式预判模型出错的能力。用户研究表明,采用此新指标可观察到显著正向效果,而传统的人机协作准确率则无此表现。结论表明,教学失败模式是可行策略,但需改进自动化发现方法并采用更优评估指标。
原文摘要 · Abstract (English)
People use large language models (LLMs) when they should not. This is partly because they see LLMs compose poems and answer intricate questions, so they understandably, but incorrectly, assume LLMs won't stumble on basic tasks like simple arithmetic. Prior work has tried to address this by clustering instance embeddings into regions where an LLM is likely to fail and automatically describing patterns in these regions. The found failure patterns are taught to users to mitigate their overreliance. Yet, this approach has not fully succeeded. In this analysis paper, we aim to understand why. We first examine whether the negative result stems from the absence of failure patterns. We group instances in two datasets by their meta-labels and evaluate an LLM's predictions on these groups. We then define criteria to flag groups that are sizable and where the LLM is error-prone, and find meta-label groups that meet these criteria. Their meta-labels are the LLM's failure patterns that could be taught to users, so they do exist. We next test whether prompting and embedding-based approaches can surface these known failures. Without this, users cannot be taught about them to reduce their overreliance. We find mixed results across methods, which could explain the negative result. Finally, we revisit the final metric that measures teaching effectiveness. We propose to assess a user's ability to effectively use the given failure patterns to anticipate when an LLM is error-prone. A user study shows a positive effect from teaching with this metric, unlike the human-AI team accuracy. Our findings show that teaching failure patterns could be a viable approach to mitigating overreliance, but success depends on better automated failure-discovery methods and using metrics like ours.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。