首个中文病人模拟数据集,让AI更真实地扮演患者。
Multi-Stage Patient Role-Playing Framework for Realistic Clinical Interactions
- 用五维人格构建病人角色,分三阶段模拟互动
- 解决角色分布不均问题,少量生成+人工校验
- 无需训练就能提升对话个性与真实感,适合医疗AI研究
真实临床交互的模拟在推动临床大语言模型发展和医学诊断教育方面具有关键作用。现有方法和基准多依赖通用或LLM生成的对话数据,限制了医患互动的真实性与多样性。本文提出首个中文病人模拟数据集(Ch-PatientSim),基于真实临床场景构建,用于全面评估模型在模拟病人行为方面的表现。病人基于五维人格结构进行建模,并通过少量样本生成与人工验证对数据集进行增强以缓解人格类别不平衡问题。我们评估了多种前沿大模型,发现多数模型生成的回答过于正式,缺乏个性特征。为此,提出无需训练的多阶段病人角色扮演(MSPRP)框架,将交互分解为三个阶段,确保响应的个性化与真实性。实验结果表明,该方法显著提升了模型在多个维度上的表现。
原文摘要 · Abstract (English)
The simulation of realistic clinical interactions plays a pivotal role in advancing clinical Large Language Models (LLMs) and supporting medical diagnostic education. Existing approaches and benchmarks rely on generic or LLM-generated dialogue data, which limits the authenticity and diversity of doctor-patient interactions. In this work, we propose the first Chinese patient simulation dataset (Ch-PatientSim), constructed from realistic clinical interaction scenarios to comprehensively evaluate the performance of models in emulating patient behavior. Patients are simulated based on a five-dimensional persona structure. To address issues of the persona class imbalance, a portion of the dataset is augmented using few-shot generation, followed by manual verification. We evaluate various state-of-the-art LLMs and find that most produce overly formal responses that lack individual personality. To address this limitation, we propose a training-free Multi-Stage Patient Role-Playing (MSPRP) framework, which decomposes interactions into three stages to ensure both personalization and realism in model responses. Experimental results demonstrate that our approach significantly improves model performance across multiple dimensions of patient simulation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。