arXiv:2608.17524cs.LG2026-08

用修复智能体漏洞的能力评估解释方法,更贴近真实应用场景。

Evaluating RL Explainability Methods by How Much They Help Fix Bugs in Agents

  • 让大模型智能体在闭环中使用XRL方法诊断并修复漏洞。
  • 通过修复成功后的奖励得分衡量不同解释方法的有效性。
  • 首次实现多种XRL方法在交互式修复中的直接对比。

本文提出一个初步的可解释强化学习(XRL)评估基准EvalXRL。现有评估多依赖于忠实度、简洁性等函数指标或人工主观评分,而本工作建议以解释方法帮助诊断并修复故障强化学习(RL)智能体的效果作为评价标准。在该基准中,一个大型语言模型(LLM)编码智能体使用不同XRL方法诊断隐藏的智能体故障,并尝试修复。评估基于环境×故障类型×XRL方法的组合迭代进行,最终以修复后智能体获得的奖励信号为评分依据。该过程支持交互式迭代:智能体可多次调用XRL方法,根据输出调整假设并重新测试。这一闭环结构模拟了简化版科学方法。部分现有方法具备自评估能力,但本研究是首个在闭环场景下对多种XRL方法进行直接比较的工作。

原文摘要 · Abstract (English)

This preliminary paper outlines a planned evaluation benchmark for Explainable Reinforcement Learning (XRL) methods. Current evaluations rely on functionally-grounded metrics like faithfulness and compactness, and on human-grounded proxies like subjective ratings or prediction accuracy. We suggest evaluating XRL methods by how effectively their generated explanations help to diagnose and fix malfunctioning reinforcement learning (RL) agents. We propose EvalXRL, a benchmark in which a Large Language Model (LLM) coding agent uses different XRL methods to diagnose a held-out malfunction in an RL agent, and then repair it. Our proposed benchmark iterates across (environment $\times$ malfunction $\times$ XRL method) tuples and uses the reward signal of the RL agents to form a final score for each XRL method. The coding agent may use the method interactively: invoke the XRL method, process its output, form new hypotheses on what is broken, and invoke the method again with parameters adjusted for testing these hypotheses. This closed-loop structure may be described as a simplified version of the scientific method. Some XRL methods provide self-evaluations that follow this pattern; we propose the first head-to-head comparison of multiple XRL methods in closed-loop usage.

可解释强化学习智能体修复评估基准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。