arXiv:2605.27784cs.AI2026-05

揭示大模型策略中指令冲突的解决方式,让隐藏的规则矛盾可见。

WIRE: Profiling Witnessed Within-Policy Instruction Collisions in LLM Agents

论文配图:WIRE: Profiling Witnessed Within-Policy Instruction Collisions in LLM Agents
图 1 · 摘自论文原文
  • 构建WIRE工具,通过编码规则并验证冲突候选,生成具体共治证据
  • 在6个公开策略中发现170对硬冲突规则,仅35.4%能同时满足双方要求
  • 适合研究模型决策机制、策略调试与系统性修复的开发者使用

大型语言模型代理依赖长期存在的提示策略,单个合理的规则可能共同作用于同一生成状态。现有评估仅关注模型是否满足显式约束,却未揭示同一策略内规则间的压力化解方式。本文提出WIRE——一种提示策略的冲突化解观测工具。它提取来源可信的规则,将其编码为PYRULE逻辑条款,仅通过可满足性检查筛选同表面的硬冲突候选,将这些候选实例化为具体的共治证据,并执行主体模型生成四类解析结果:同时满足、仅满足前者、仅满足后者或均不满足。在六个公开提示策略中,WIRE提取276条源规则和560个条款,分类30,944对条款组合,保留170对编码后的硬冲突源规则对,实现1,402个具体见证实例。在纯策略评估中,这些见证产生13,335个联合治理、可判断的测试场景,仅有35.4%同时满足被治理规则。生成的解析图谱揭示了策略、模型及工具接口层面的差异化解决模式。WIRE并非自然语言矛盾证明、部署频率估计或根本原因诊断工具,而是一种可复现的测量工具,提供可检查、可用于回归测试与修复的证据与聚合画像。

原文摘要 · Abstract (English)

LLM agents are governed by long-lived prompt policies, where individually reasonable stand- ing rules can jointly govern the same pre- generation state. Existing instruction-following evaluations usually ask whether a model satis- fies explicit constraints, but they do not show how a model resolves pressure among rules inside one standing policy. We introduce WIRE, a witnessed resolu- tion profiler for prompt policies. WIRE ex- tracts source-grounded rules, encodes them as PYRULE clauses, uses satisfiability checks only to nominate same-surface hard-collision can- didates, realizes those candidates as concrete co-governance witnesses, and executes subject models to produce a four-cell resolution profile: satisfy both rules, only the earlier rule, only the later rule, or neither. Across six public prompt policies, WIRE ex- tracts 276 source rules and 560 clauses, clas- sifies 30,944 within-policy clause-pair com- parisons, retains 170 encoded hard-collision source-rule pairs, and realizes 1,402 concrete witnesses. In policy-only evaluation, these wit- nesses yield 13,335 jointly governed, judgeable trials; only 35.4% satisfy both governed rules. The resulting profiles reveal policy-specific, model-specific, and tool-interface-specific res- olution patterns. WIRE is not a proof of natural-language contra- diction, a deployment-frequency estimator, or a root-cause diagnosis. It is a measurement tool that returns reproducible witnesses and aggre- gate profiles for inspection, regression testing, and repair.

大模型规则冲突评估工具推理机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。