用边缘计算+云端协作,让机器人更懂老人记忆训练需求
An Edge-Host-Cloud Architecture for Robot-Agnostic, Caregiver-in-the-Loop Personalized Cognitive Exercise: Multi-Site Deployment in Dementia Care
- 分层架构融合照护者知识与本地边缘智能,实现个性化对话
- 响应延迟低于6秒,多模态同步稳定,使用者反馈积极
- 适合认知症照护场景,支持跨设备部署与长期个性化
我们提出Speaking Memories,一个分布式、多方参与的机器人交互平台,用于个性化认知训练支持。该平台不依赖特定机器人,而是将照护者构建的知识、本地边缘智能与具身机器人代理整合为统一的社会技术闭环。系统融合听觉、视觉和文本信号,实现情绪感知的个性化对话,并通过本地边缘交互服务器将多模态感知与推理解耦于具体硬件,实现低延迟、隐私保护的操作,支持异构机器人形态的可扩展部署。照护者与家属可通过安全云端门户提交结构化传记知识,用于调节下游对话策略,实现跨会话的长期个性化。系统还包含自动化多模态评估层,持续分析用户反应、情感线索与参与模式,生成可量化的交互指标。这些指标支持交互质量的系统性评估、数据驱动模型调优,并为未来临床医生与照护者协同的个性化干预规划奠定基础。我们在真实场景中评估了平台,测量端到端延迟、对话连贯性、交互稳定性以及利益相关者报告的可用性与参与度。结果表明响应延迟低于6秒,多模态同步鲁棒,参与者与照护者均给出积极反馈。部分数据集可在获得参与者同意与IRB批准后共享。
原文摘要 · Abstract (English)
We present Speaking Memories, a distributed, stakeholder-in-the-loop robotic interaction platform for personalized cognitive exercise support. Rather than a single robot-centric system, Speaking Memories is designed as a generalizable robotics architecture that integrates caregiver-authored knowledge, local edge intelligence, and embodied robotic agents into a unified socio-technical loop. The platform fuses auditory, visual, and textual signals to enable emotion-aware, personalized dialogue, while decoupling multimodal perception and reasoning from robot-specific hardware through a local edge interaction server. This design achieves low-latency, privacy-preserving operation and supports scalable deployment across heterogeneous robotic embodiments. Caregivers and family members contribute structured biographical knowledge via a secure cloud portal, which conditions downstream dialogue policies and enables longitudinal personalization across interaction sessions. Beyond real-time interaction, the system incorporates an automated multimodal evaluation layer that continuously analyzes user responses, affective cues, and engagement patterns, producing structured interaction metrics at scale. These metrics support systematic assessment of interaction quality, enable data-driven model fine-tuning, and lay the foundation for future clinician- and caregiver-informed personalization and intervention planning. We evaluate the platform through real-world deployments, measuring end-to-end latency, dialogue coherence, interaction stability, and stakeholder-reported usability and engagement. Results demonstrate sub-6-second response latency, robust multimodal synchronization, and consistently positive feedback from both participants and caregivers. Furthermore, subsets of the dataset can be shared upon request, subject to participant consent and IRB constraints.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。