首次为强化学习生成'若...仍会...'的解释,提升决策可理解性。
Semifactual Explanations for Reinforcement Learning
- 提出五条理想解释标准,设计两个新算法生成半事实解释
- 在标准环境测试中,生成的解释更易达成、更贴近策略、更具多样性
- 用户研究验证其对理解智能体行为有实际帮助,适合高风险场景
强化学习(RL)通过试错让智能体从环境中学习,深度强化学习(DRL)使用神经网络表示策略,导致决策过程难以解释。解释DRL智能体行为对增强用户信任、提升参与度和推动真实任务应用至关重要。半事实解释通过‘即使……也……’的假设情景说明结果,如‘即使车速减半,仍需急转避撞’,帮助用户理解各因素对结果的影响,并支持资源优化。尽管在心理学和监督学习中已有研究,但半事实解释尚未用于解释强化学习系统。本文首次提出生成强化学习半事实解释的方法,定义了五项理想解释属性,并引入两种新算法:SGRL-Rewind 和 SGRL-Advance。在两个标准强化学习环境中评估显示,所提方法生成的解释更易实现、更能反映智能体策略、且更具多样性。最后,通过用户研究分析参与者对解释效果的感知。
原文摘要 · Abstract (English)
Reinforcement Learning (RL) is a learning paradigm in which the agent learns from its environment through trial and error. Deep reinforcement learning (DRL) algorithms represent the agent's policies using neural networks, making their decisions difficult to interpret. Explaining the behaviour of DRL agents is necessary to advance user trust, increase engagement, and facilitate integration with real-life tasks. Semifactual explanations aim to explain an outcome by providing "even if" scenarios, such as "even if the car were moving twice as slowly, it would still have to swerve to avoid crashing". Semifactuals help users understand the effects of different factors on the outcome and support the optimisation of resources. While extensively studied in psychology and even utilised in supervised learning, semifactuals have not been used to explain the decisions of RL systems. In this work, we develop a first approach to generating semifactual explanations for RL agents. We start by defining five properties of desirable semifactual explanations in RL and then introducing SGRL-Rewind and SGRL-Advance, the first algorithms for generating semifactual explanations in RL. We evaluate the algorithms in two standard RL environments and find that they generate semifactuals that are easier to reach, represent the agent's policy better, and are more diverse compared to baselines. Lastly, we conduct and analyse a user study to assess the participant's perception of semifactual explanations of the agent's actions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。