arXiv:2508.20923cs.LGcs.SY2025-08

针对动态变化的干预效果,提出可保证短期表现的多智能体资源分配算法。

Finite-Time Guarantees for Multi-Agent Combinatorial Bandits with Nonstationary Rewards

  • 设计基于动态奖励的组合多臂老虎机框架,支持个体行为演化建模
  • 算法实现动态后悔上界,糖尿病干预案例提升3倍参与率
  • 适合需要个性化干预的公共健康与人力资源场景

我们研究一个序列资源分配问题:决策者每期需选择一组智能体以最大化整体效果,但对个体影响缺乏先验知识。该框架适用于社区健康干预、精准数字广告和员工留存计划等场景,其中干预效果随时间动态演变。智能体可能产生习惯化(频繁选择后响应减弱)或恢复(长期未选后响应增强)。核心挑战在于非平稳奖励分布导致干预效果持续变化。问题需权衡异质性个体奖励与探索-利用冲突:是为未来学习而牺牲即时收益,还是追求当下最优。本文首次在组合多臂老虎机中引入此类非平稳奖励,提出具备动态后悔理论保证的算法,并通过糖尿病干预案例验证其实际效能。所提个性化社区干预算法相较基线方法提升最高达三倍的项目参与度,证明了该框架在现实应用中的潜力。本工作连接自适应学习的理论进展与群体行为改变干预的实际挑战。

原文摘要 · Abstract (English)

We study a sequential resource allocation problem where a decision maker selects subsets of agents at each period to maximize overall outcomes without prior knowledge of individual-level effects. Our framework applies to settings such as community health interventions, targeted digital advertising, and workforce retention programs, where intervention effects evolve dynamically. Agents may exhibit habituation (diminished response from frequent selection) or recovery (enhanced response from infrequent selection). The technical challenge centers on nonstationary reward distributions that lead to changing intervention effects over time. The problem requires balancing two key competing objectives: heterogeneous individual rewards and the exploration-exploitation tradeoff in terms of learning for improved future decisions as opposed to maximizing immediate outcomes. Our contribution introduces the first framework incorporating this form of nonstationary rewards in the combinatorial multi-armed bandit literature. We develop algorithms with theoretical guarantees on dynamic regret and demonstrate practical efficacy through a diabetes intervention case study. Our personalized community intervention algorithm achieved up to three times as much improvement in program enrollment compared to baseline approaches, validating the framework's potential for real-world applications. This work bridges theoretical advances in adaptive learning with practical challenges in population-level behavioral change interventions.

多智能体在线学习非平稳资源分配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。