arXiv:2502.13135cs.LGcs.AI2025-02ACL被引 7

用真实健康数据生成虚拟用户,让教练机器人更逼真地互动。

Sleepless Nights, Sugary Days: Creating Synthetic Users with Health Conditions for Realistic Coaching Agent Interactions

  • 基于睡眠与糖尿病管理数据生成带健康属性的虚拟用户
  • 相比通用虚拟用户,能更准确模拟真实用户行为与需求
  • 适合用于评估健康类对话机器人,提升测试真实性

我们提出一个端到端框架,用于生成用于评估健康与生活方式教练类交互代理的合成用户。合成用户基于真实世界的健康与生活方式因素(本研究聚焦睡眠与糖尿病管理)构建,以确保与教练代理的互动具有现实性。合成用户生成分为两阶段:首先生成包含基本人口统计、行为特征及真实健康因素的结构化数据;其次在此基础上构建完整的用户画像。通过生成式代理模型(如Concordia)或直接提示语言模型,模拟合成用户与教练代理的交互。以两个独立开发的睡眠与糖尿病教练代理为案例,验证了该框架的有效性,分析显示代理对合成用户的需求数和挑战理解更准确。通过多位盲评专家对用户-教练交互的评估,结果表明,带有健康与行为属性的合成用户比无此属性的通用合成用户更能真实反映具有相同特征的真实用户。该框架为通过大量真实、有依据的模拟交互高效开发对话代理奠定了基础。

原文摘要 · Abstract (English)

We present an end-to-end framework for generating synthetic users for evaluating interactive agents designed to encourage positive behavior changes, such as in health and lifestyle coaching. The synthetic users are grounded in health and lifestyle conditions, specifically sleep and diabetes management in this study, to ensure realistic interactions with the health coaching agent. Synthetic users are created in two stages: first, structured data are generated grounded in real-world health and lifestyle factors in addition to basic demographics and behavioral attributes; second, full profiles of the synthetic users are developed conditioned on the structured data. Interactions between synthetic users and the coaching agent are simulated using generative agent-based models such as Concordia, or directly by prompting a language model. Using two independently-developed agents for sleep and diabetes coaching as case studies, the validity of this framework is demonstrated by analyzing the coaching agent's understanding of the synthetic users' needs and challenges. Finally, through multiple blinded evaluations of user-coach interactions by human experts, we demonstrate that our synthetic users with health and behavioral attributes more accurately portray real human users with the same attributes, compared to generic synthetic users not grounded in such attributes. The proposed framework lays the foundation for efficient development of conversational agents through extensive, realistic, and grounded simulated interactions.

健康对话合成数据虚拟用户

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。