研究用户为通过模型而改变行为时,如何导致模型标准不断上升的恶性循环。
Understanding Endogenous Data Drift in Adaptive Models with Recourse-Seeking Users
- 构建用户策略行为与模型互动的通用框架,考虑资源约束和竞争环境。
- 实证发现用户寻路行为使模型决策标准越来越高,导致寻路成本上升。
- 提出公平top-k与动态持续学习方法,降低寻路成本,提升模型鲁棒性。
深度学习模型广泛应用于决策与推荐系统,通常假设训练与部署阶段数据分布保持静态。然而现实环境中这一假设常被打破:收到负面结果的用户会调整自身特征以满足模型要求(即寻路行为)。这种适应性行为引发数据分布漂移,当模型基于新数据重新训练时,形成反馈循环——用户行为影响模型,更新后的模型又重塑未来用户行为。尽管重要,这种双向互动仍缺乏关注。本文构建一个通用框架,建模用户在资源约束与竞争动态下的策略行为及其与决策系统的交互。理论与实证分析表明,用户寻路行为促使逻辑回归与MLP模型逐步趋向更高决策标准,导致寻路成本升高且寻路行为可靠性下降。为此,我们提出公平top-k与动态持续学习(DCL)两种方法,显著降低寻路成本并提升模型鲁棒性。研究结果呼应经济理论,揭示算法决策可能无意中强化高门槛,生成内生性进入壁垒。
原文摘要 · Abstract (English)
Deep learning models are widely used in decision-making and recommendation systems, where they typically rely on the assumption of a static data distribution between training and deployment. However, real-world deployment environments often violate this assumption. Users who receive negative outcomes may adapt their features to meet model criteria, i.e., recourse action. These adaptive behaviors create shifts in the data distribution and when models are retrained on this shifted data, a feedback loop emerges: user behavior influences the model, and the updated model in turn reshapes future user behavior. Despite its importance, this bidirectional interaction between users and models has received limited attention. In this work, we develop a general framework to model user strategic behaviors and their interactions with decision-making systems under resource constraints and competitive dynamics. Both the theoretical and empirical analyses show that user recourse behavior tends to push logistic and MLP models toward increasingly higher decision standards, resulting in higher recourse costs and less reliable recourse actions over time. To mitigate these challenges, we propose two methods--Fair-top-k and Dynamic Continual Learning (DCL)--which significantly reduce recourse cost and improve model robustness. Our findings draw connections to economic theories, highlighting how algorithmic decision-making can unintentionally reinforce a higher standard and generate endogenous barriers to entry.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。