用大模型+强化学习,让电动车推广话术更懂人心。
Leveraging Language Models and Bandit Algorithms to Drive Adoption of Battery-Electric Vehicles
- 用上下文强化学习匹配用户价值观,定制对话策略。
- 对比实验显示,个性化干预说服力提升27%以上。
- 适合做绿色政策、低碳推广的精准沟通方案。
行为改变干预对推动社会行动至关重要,例如促进电池电动车辆的采用以减少排放。以往研究指出,干预措施需个性化;而对整体群体最有效的干预可能引发部分子群体的抵触情绪。因此,针对不同受众进行精准干预,并以自然对话形式呈现尤为重要。在此背景下,大型语言模型(LLMs)在生成行为改变的对话干预方面展现出新潜力。本文基于对电动车采纳动机价值的研究,结合最新大模型进展与上下文强化学习算法(contextual bandit),开发出可根据参与者个人价值观定制的对话式干预策略。利用上下文强化学习算法,根据参与者的社会人口特征动态选择最优价值主张。为离线训练该算法,我们使用大模型模拟研究参与者进行交互测试。将经过强化学习优化的大模型与未针对人口特征调整价值的原始大模型进行对比,评估其在说服效果上的表现。
原文摘要 · Abstract (English)
Behavior change interventions are important to coordinate societal action across a wide array of important applications, including the adoption of electrified vehicles to reduce emissions. Prior work has demonstrated that interventions for behavior must be personalized, and that the intervention that is most effective on average across a large group can result in a backlash effect that strengthens opposition among some subgroups. Thus, it is important to target interventions to different audiences, and to present them in a natural, conversational style. In this context, an important emerging application domain for large language models (LLMs) is conversational interventions for behavior change. In this work, we leverage prior work on understanding values motivating the adoption of battery electric vehicles. We leverage new advances in LLMs, combined with a contextual bandit, to develop conversational interventions that are personalized to the values of each study participant. We use a contextual bandit algorithm to learn to target values based on the demographics of each participant. To train our bandit algorithm in an offline manner, we leverage LLMs to play the role of study participants. We benchmark the persuasive effectiveness of our bandit-enhanced LLM against an unaided LLM generating conversational interventions without demographic-targeted values.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。