测试大模型处理多轮纠缠指令的能力,发现其在冲突解决上仍有短板。
Can Language Models Follow Multiple Turns of Entangled Instructions?
- 构建1.1千条高质量多轮对话数据集,分三难度评估指令理解能力
- 大模型记忆力强但隐私保护弱,推理强却难解决指令冲突
- 揭示注意力机制难以整合多相关指令,适合研究多轮交互的开发者
尽管大语言模型在指令遵循方面取得显著进展,但处理多轮可能纠缠或冲突的指令仍面临重大挑战。现实场景常需跨轮保持一致性,如隐私保护、个人偏好和优先级排序,要求模型在指令交叉或冲突时具备复杂整合与权衡能力。本文系统考察了大模型在多轮指令处理中的能力,涵盖三个难度层级:(1)从指令中检索信息,(2)跨轮跟踪与推理,(3)解决指令冲突。我们通过人机协作构建了约1.1千条高质量多轮对话数据集,形成九类能力类别,包括静态与动态、推理及多任务处理。研究发现存在显著能力权衡:GPT模型虽记忆能力强,但在需选择性隐瞒信息的隐私任务中表现差;更大模型推理能力更强,但仍难以解决冲突指令。这些性能差距并非仅因信息丢失所致,因模型在记忆任务上仍有高BLEU得分。然而,其注意力机制无法有效整合多个相关指令。该结果揭示了复杂现实任务中多轮指令处理的关键改进方向。数据与代码已开源至https://github.com/Glaciohound/Multi-Turn-Instruct。
原文摘要 · Abstract (English)
Despite significant achievements in improving the instruction-following capabilities of large language models (LLMs), the ability to process multiple potentially entangled or conflicting instructions remains a considerable challenge. Real-world scenarios often require consistency across multiple instructions over time, such as secret privacy, personal preferences, and prioritization, which demand sophisticated abilities to integrate multiple turns and carefully balance competing objectives when instructions intersect or conflict. This work presents a systematic investigation of LLMs' capabilities in handling multiple turns of instructions, covering three levels of difficulty: (1) retrieving information from instructions, (2) tracking and reasoning across turns, and (3) resolving conflicts among instructions. We construct MultiTurnInstruct~with $\sim$1.1K high-quality multi-turn conversations through the human-in-the-loop approach and result in nine capability categories, including statics and dynamics, reasoning, and multitasking. Our finding reveals an intriguing trade-off between different capabilities. While GPT models demonstrate superior memorization, they show reduced effectiveness in privacy-protection tasks requiring selective information withholding. Larger models exhibit stronger reasoning capabilities but still struggle with resolving conflicting instructions. Importantly, these performance gaps cannot be attributed solely to information loss, as models demonstrate strong BLEU scores on memorization tasks. Still, their attention mechanisms fail to integrate multiple related instructions effectively. These findings highlight critical areas for improvement in complex real-world tasks involving multi-turn instructions. Data and codes are released at https://github.com/Glaciohound/Multi-Turn-Instruct.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。