用大模型生成个性化运动激励,智能选策略更高效。
Tailored Behavior-Change Messaging for Physical Activity: Integrating Contextual Bandits and Large Language Models
- 用上下文强化学习选干预类型,大模型动态生成内容。
- 混合模型比纯随机或单模型提升17%的参与度与满意度。
- 适合需要个性推荐又重视可解释性的健康干预研究者。
情境化多臂老虎机(cMAB)算法为随时间调整个体行为干预提供了潜力,但通常需大量数据且依赖预设消息模板。本文提出cMABxLLM混合方法:由cMAB选择干预类型,大语言模型(LLM)在该类型内个性化生成内容。在为期30天的运动干预中,比较四种干预类型——行为自我监测、收益框架、损失框架、社会比较——通过每日激励信息支持每日步数目标。消息内容根据自效能、社会影响和调节焦点等动态上下文因素个性化。参与者被分配至五种模型之一:随机对照(RCT)、仅cMAB、仅LLM、含交互历史的LLM,或cMABxLLM。结果通过生态瞬时评估(EMAs)衡量动机与消息有用性。统计分析控制重复测量与时间趋势。结果显示,cMABxLLM保留了LLM生成消息的接受度,降低52%的令牌使用量,并提供明确可复现的干预选择规则。该方法还缓解了干预类型分配偏差,增强对低频类型的覆盖。本研究为贝叶斯自适应实验与生成模型结合提供可部署模板,兼顾个性化与可解释性。
原文摘要 · Abstract (English)
Contextual multi-armed bandit (cMAB) algorithms offer a promising framework for adapting behavioral interventions to individuals over time. However, cMABs often require large samples to learn effectively and typically rely on a finite pre-set of fixed message templates. In this paper, we present a hybrid cMABxLLM approach in which the cMAB selects an intervention type, and a large language model (LLM) which personalizes the message content within the selected type. We deployed this approach in a 30-day physical-activity intervention, comparing four behavioral change intervention types: behavioral self-monitoring, gain-framing, loss-framing, and social comparison, delivered as daily motivational messages to support motivation and achieve a daily step count. Message content is personalized using dynamic contextual factors, including daily fluctuations in self-efficacy, social influence, and regulatory focus. Over the trial, participants received daily messages assigned by one of five models: equal randomization (RCT), cMAB only, LLM only, LLM with interaction history, or cMABxLLM. Outcomes include motivation towards physical activity and message usefulness, assessed via ecological momentary assessments (EMAs). We evaluate and compare the five delivery models using pre-specified statistical analyses that account for repeated measures and time trends. We find that the cMABxLLM approach retains the perceived acceptance of LLM-generated messages, while reducing token usage and providing an explicit, reproducible decision rule for intervention selection. This hybrid approach also avoids the skew in intervention delivery by improving support for under-delivered intervention types. More broadly, our approach provides a deployable template for combining Bayesian adaptive experimentation with generative models in a way that supports both personalization and interpretability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。