提出健康对话机器人前端伦理设计框架,防范传感器数据误译带来的医疗风险。
Front-End Ethics for Sensor-Fused Health Conversational Agents: An Ethical Design Space for Biometrics

- 构建五维伦理设计空间,涵盖生物指标披露与解释框架
- 发现传感器数据误译可能引发有害医疗指令,形成生物反馈循环
- 提出自适应披露机制,保障用户自主权,适合健康AI开发者参考
内置传感器与大语言模型的融合推动了个人健康支持类智能体的发展。尽管现有研究聚焦于生成式AI的后端伦理(如传感准确性、训练数据偏见、多模态融合),但忽略了前端关键问题:无形生物指标如何被转化为用户直接感知的语言。本文指出,传感器数据的“客观性幻觉”会放大AI幻觉风险,导致错误信息被当作医疗指令。为此,提出“伦理前端设计”概念,构建包含生物指标披露、监测时间性、解释框架、AI立场和可争议性的五维设计空间,并分析其在用户或系统发起场景下的交互影响。研究揭示生物反馈回路风险,提出“自适应披露”作为安全防护机制,为开发者提供管理不可靠性的设计指南,确保先进健康智能体真正辅助而非削弱用户自主。
原文摘要 · Abstract (English)
The integration of continuous data from built-in sensors and Large Language Models (LLMs) has fueled a surge of "Sensor-Fused LLM agents" for personal health and well-being support. While recent breakthroughs have demonstrated the technical feasibility of this fusion (e.g., Time-LLM, SensorLLM), research primarily focuses on "Ethical Back-End Design for Generative AI", concerns such as sensing accuracy, bias mitigation in training data, and multimodal fusion. This leaves a critical gap at the front end, where invisible biometrics are translated into language directly experienced by users. We argue that the "illusion of objectivity" provided by sensor data amplifies the risks of AI hallucinations, potentially turning errors into harmful medical mandates. This paper shifts the focus to "Ethical Front-End Design for AI", specifically, the ethics of biometric translation. We propose a design space comprising five dimensions: Biometric Disclosure, Monitoring Temporality, Interpretation Framing, AI Stance, and Contestability. We examine how these dimensions interact with context (user- vs. system-initiated) and identify the risk of biofeedback loops. Finally, we propose "Adaptive Disclosure" as a safety guardrail and offer design guidelines to help developers manage fallibility, ensuring that these cutting-edge health agents support, rather than destabilize, user autonomy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。