用大模型将老人追踪数据转化为有温度的叙事,帮远亲读懂生活状态。
From 'What' to 'How' and 'Why': Sharing LLM-Generated Retrospective Summaries of Older Adults' Passive Tracking Data with Remote Family Members

- 构建多层多代理系统,从客观数据生成带上下文的叙述性摘要。
- 11位远亲用户反馈:新摘要在帮助理解、信任感上显著提升。
- 适合关注老年人照护、希望深入理解亲人日常的家庭成员。
随着普适计算技术普及,多模态追踪系统有望为远程家庭成员(RFMs)提供及时关怀与安心。然而,将异构数据流整合为有意义的回顾性摘要仍具挑战。尽管大语言模型(LLMs)在解析多模态数据方面展现潜力,但针对具备丰富个人知识与情感责任却缺乏日常可见性的RFMs,生成叙事性内容的研究仍不足。本文探索如何利用LLMs从多模态追踪数据生成面向RFMs的回顾性摘要。我们基于现有系统Vital Insight,在不同日期与数据可用性场景下生成初始摘要,并通过访谈11位RFMs收集反馈。据此重构为多层、多代理、以洞察驱动的摘要框架,从客观统计逐步生成情境化叙述。随后通过问卷对比新旧版本,发现新摘要在满意度、感知帮助性、信任度及接收意愿上均有显著提升。研究提出面向家庭成员的AI摘要设计启示,强调需支持从呈现‘有什么’数据,转向解释‘怎么样’和‘为什么’的深层意义。
原文摘要 · Abstract (English)
With the growing prevalence of modern ubiquitous computing technologies, multi-modal tracking systems hold promise for providing timely awareness and reassurance to stakeholders such as remote family members (RFMs) of older adults, who play a central role in care coordination. However, combining heterogeneous data streams into high-level, meaningful content - such as retrospective summaries - remains challenging. While recent work has demonstrated the promise of large language models (LLMs) for interpreting multi-modal tracking data, less attention has been given to generating narrative accounts for stakeholders like RFMs, who possess rich personal knowledge of older adults and strong emotional responsibility, yet have limited visibility into their daily lives and limited capacity for caregiving. In this work, we explore how LLMs can be used to generate retrospective summaries from multi-modal tracking data for RFMs of older adults. We leveraged and customized an existing system, Vital Insight, to generate initial summaries on different dates and data availability scenarios as technology probes, and conducted interviews with 11 RFMs to gather feedback. Based on these insights, we redesigned the system into a multi-layer, multi-agent, insight-driven summary approach that builds from objective statistics and descriptions to enriched, context-aware narratives. We then compared the redesigned summaries with the initial versions through a survey with the same 11 RFMs and found significant improvements in satisfaction, perceived helpfulness, trust, and willingness to receive the summaries. We conclude by presenting design implications for AI-generated summaries for RFMs and broader contexts, emphasizing the need to support RFMs' sensemaking shift from simply presenting ''What'' data were collected, to explaining ''How'' is my loved one doing and ''Why''.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。