用偏好优化让大模型更懂医疗共情,对话更可信更温暖
Empathy by Design: Aligning Large Language Models for Healthcare Dialogue
- 基于人类偏好数据直接优化,提升对话的共情与可理解性
- 在多个模型上验证,事实准确率与共情评分均优于主流系统
- 适合开发医疗陪护、心理健康等需要温度的AI助手
通用大语言模型虽具强大生成与推理能力,但在医疗和照护场景中仍受限于事实不可靠与缺乏共情。为解决这一问题,我们提出一种基于直接偏好优化(DPO)的对齐框架,通过成对偏好数据微调领域适配的大模型,使优选回复体现支持性、易懂的沟通风格,而被拒回复则为说教或过于专业的表达。该方法比传统强化学习更高效地对齐人类偏好。在多个开源与专有大模型上的实证评估显示,本方法显著提升语义一致性、事实准确率及人性化评价得分,优于基线模型与谷歌医疗对话系统。结果表明,基于偏好的对齐是构建可信、共情且具备临床知识的医疗AI助手的可扩展、透明路径。代码已开源。
原文摘要 · Abstract (English)
General-purpose large language models (LLMs) have demonstrated remarkable generative and reasoning capabilities but remain limited in healthcare and caregiving applications due to two key deficiencies: factual unreliability and a lack of empathetic communication. These shortcomings pose significant risks in sensitive contexts where users, particularly non-professionals and caregivers, seek medically relevant guidance or emotional reassurance. To address these challenges, we introduce a Direct Preference Optimization (DPO)-based alignment framework designed to improve factual correctness, semantic coherence, and human-centric qualities such as empathy, politeness, and simplicity in caregiver-patient dialogues. Our approach fine-tunes domain-adapted LLMs using pairwise preference data, where preferred responses reflect supportive and accessible communication styles while rejected ones represent prescriptive or overly technical tones. This direct optimization method aligns model outputs with human preferences more efficiently than traditional reinforcement-learning-based alignment. Empirical evaluations across multiple open and proprietary LLMs show that our DPO-tuned models achieve higher semantic alignment, improved factual accuracy, and stronger human-centric evaluation scores compared to baseline and commercial alternatives such as Google medical dialogue systems. These improvements demonstrate that preference-based alignment offers a scalable and transparent pathway toward developing trustworthy, empathetic, and clinically informed AI assistants for caregiver and healthcare communication. Our open-source code is available at: https://github.com/LeonG19/Empathy-by-Design
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。