arXiv:2508.10060cs.LG2025-08被引 4

用强化学习个性化运动提醒,显著提升用户每日步数。

A Personalized Exercise Assistant using Reinforcement Learning (PEARL): Results from a four-arm Randomized-controlled Trial

  • 基于行为科学理论的强化学习算法动态选择运动提醒内容与时机。
  • 实验组比对照组平均每日多走296步,持续效果显著。
  • 适合对数字健康干预、个性化推荐感兴趣的研究者与开发者。

久坐不动是全球性的重大健康挑战。移动健康(mHealth)干预,特别是即时自适应干预(JITAIs),为可扩展、个性化的身体活动(PA)促进提供了前景。然而,在整合扎实的行为科学基础上大规模开发和评估此类干预措施,面临方法论难题。PEARL研究是首个大规模四臂随机对照试验,评估了基于健康行为改变理论的强化学习(RL)算法,通过Fitbit应用个性化推送运动提醒。共招募并随机分组13,463名Fitbit用户,分为对照组、随机组、固定组和RL组。对照组无提醒;其余三组从155条基于行为科学原则的提醒中获取推送。随机组由系统随机选择提醒;固定组依据用户调查反馈的活动障碍预设逻辑推送;RL组由自适应强化学习算法选择提醒。主要分析纳入7,711名参与者(平均年龄42.1岁,女性占86.3%,基线步数5,618.2)。与所有其他组相比,RL组在1个月和2个月时均表现出身体活动增加。在1个月时,RL组相比对照组(+296步,p=0.0002)、随机组(+218步,p=0.005)和固定组(+238步,p=0.002)平均每日步数显著提升。2个月时,相比对照组仍显著增加(+210步,p=0.0122)。广义估计方程模型进一步显示,相比对照组,RL组日均步数持续增加208步(p=0.002)。这些结果表明,可扩展且基于行为科学的强化学习方法在个性化数字健康干预中具有潜力。

原文摘要 · Abstract (English)

Consistent physical inactivity poses a major global health challenge. Mobile health (mHealth) interventions, particularly Just-in-Time Adaptive Interventions (JITAIs), offer a promising avenue for scalable, personalized physical activity (PA) promotion. However, developing and evaluating such interventions at scale, while integrating robust behavioral science, presents methodological hurdles. The PEARL study was the first large-scale, four-arm randomized controlled trial to assess a reinforcement learning (RL) algorithm, informed by health behavior change theory, to personalize the content and timing of PA nudges via a Fitbit app. We enrolled and randomized 13,463 Fitbit users into four study arms: control, random, fixed, and RL. The control arm received no nudges. The other three arms received nudges from a bank of 155 nudges based on behavioral science principles. The random arm received nudges selected at random. The fixed arm received nudges based on a pre-set logic from survey responses about PA barriers. The RL group received nudges selected by an adaptive RL algorithm. We included 7,711 participants in primary analyses (mean age 42.1, 86.3% female, baseline steps 5,618.2). We observed an increase in PA for the RL group compared to all other groups from baseline to 1 and 2 months. The RL group had significantly increased average daily step count at 1 month compared to all other groups: control (+296 steps, p=0.0002), random (+218 steps, p=0.005), and fixed (+238 steps, p=0.002). At 2 months, the RL group sustained a significant increase compared to the control group (+210 steps, p=0.0122). Generalized estimating equation models also revealed a sustained increase in daily steps in the RL group vs. control (+208 steps, p=0.002). These findings demonstrate the potential of a scalable, behaviorally-informed RL approach to personalize digital health interventions for PA.

强化学习健康干预个性化运动促进

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。