arXiv:2509.22102cs.LGcs.AI2025-09被引 3

让推荐方案更持久,支持用户后续重申申请。

Reinforcement Learning for Durable Algorithmic Recourse

  • 用强化学习建模推荐对申请人池的长期影响。
  • 在模拟环境中显著提升推荐的可行性和长期有效性。
  • 适合关注长期公平与可执行性的决策系统设计者。

算法救济旨在为个人提供可操作的建议,以提高其获得自动化决策系统有利结果(如贷款批准)的可能性。尽管以往研究强调对模型更新的鲁棒性,但对救济的时间动态关注较少,尤其是在竞争激烈、资源受限的场景中,推荐会改变未来的申请人构成。本文提出一种新型时序感知的算法救济框架,显式建模候选人群对推荐的适应行为。此外,我们引入基于强化学习(RL)的救济算法,捕捉环境演化动态,生成既可行又有效的建议。我们的建议具有耐久性,在预定义时间窗T内保持有效,使个体有足够时间实施并自信地再次申请。在复杂模拟环境中的大量实验表明,该方法显著优于现有基线,更好地平衡了可行性与长期有效性。这些结果凸显了在实际救济系统设计中纳入时间与行为动态的重要性。

原文摘要 · Abstract (English)

Algorithmic recourse seeks to provide individuals with actionable recommendations that increase their chances of receiving favorable outcomes from automated decision systems (e.g., loan approvals). While prior research has emphasized robustness to model updates, considerably less attention has been given to the temporal dynamics of recourse--particularly in competitive, resource-constrained settings where recommendations shape future applicant pools. In this work, we present a novel time-aware framework for algorithmic recourse, explicitly modeling how candidate populations adapt in response to recommendations. Additionally, we introduce a novel reinforcement learning (RL)-based recourse algorithm that captures the evolving dynamics of the environment to generate recommendations that are both feasible and valid. We design our recommendations to be durable, supporting validity over a predefined time horizon T. This durability allows individuals to confidently reapply after taking time to implement the suggested changes. Through extensive experiments in complex simulation environments, we show that our approach substantially outperforms existing baselines, offering a superior balance between feasibility and long-term validity. Together, these results underscore the importance of incorporating temporal and behavioral dynamics into the design of practical recourse systems.

算法救济强化学习可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。