用树搜索自动生成干扰信息,测试大模型在干扰下的推理稳定性。
Adaptive Distraction: Probing LLM Contextual Robustness with Automated Tree Search
- 基于模型反馈的树搜索动态生成干扰内容。
- 使主流模型平均性能下降超45%,验证了干扰有效性。
- 适合关注大模型鲁棒性与安全性的研究者使用。
大型语言模型在面对语义连贯但任务无关的上下文信息时,常出现性能下降。现有固定模板或检索式干扰方法对当前模型效果有限。本文提出一种基于树搜索的动态干扰生成框架,通过模型行为引导生成过程,不修改原问题与答案,高效生成跨多个数据集的挑战性干扰,实现对大模型上下文鲁棒性的系统性压力测试。四组基准实验表明,生成的干扰导致主流模型平均性能下降超过45%。进一步对比缓解策略发现,提示优化方法增益有限,而后续训练方法(如DPO)能显著提升模型的上下文鲁棒性。结果表明,该问题并非源于知识缺失,而是模型在上下文干扰下保持一致推理的根本性缺陷,严重威胁大模型在真实场景中的可靠性。代码已开源:https://github.com/wyf23187/Adaptive_Distractions。
原文摘要 · Abstract (English)
Large Language Models (LLMs) often struggle to maintain their original performance when faced with semantically coherent but task-irrelevant contextual information. Although prior studies have explored this issue using fixed-template or retrieval-based distractions, such static methods show limited effectiveness against contemporary models. To address this problem, we propose a dynamic distraction generation framework based on tree search, where the generation process is guided by model behavior. Without modifying the original question or answer, the method efficiently produces challenging adaptive distractions across multiple datasets, enabling systematic stress testing of LLMs' contextual robustness. Experiments on four benchmarks demonstrate that the generated distractions lead to an average performance drop of over 45\% for mainstream models. Further comparisons of mitigation strategies show that prompt-based optimization methods yield limited gains, whereas post-training approaches (e.g., DPO) significantly enhance the model's contextual robustness. The results indicate that these issues do not stem from knowledge deficits in LLMs, but from a fundamental inability to maintain consistent reasoning under contextual distraction, posing a major challenge to the reliability of LLMs in real-world applications. The code is publicly available at https://github.com/wyf23187/Adaptive_Distractions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。