用人格模型生成真实多样的虚拟病人,提升医疗大模型测试效果
Patients With Personality: Realistic Patient Simulation through Controlled Diversity and Selective Disclosure

- 基于六维人格模型控制虚拟病人行为,实现对话风格与信息披露的精细调节
- 临床评估显示其真实度接近真人,且过度透露信息情况减少70%以上
- 适合医疗AI测试、临床训练系统开发人员使用
大规模测试医疗大模型需真实可靠的患者交互模拟,但现有方法常缺乏真实感和可控性,易无端透露信息,且无法捕捉患者行为多样性。本文提出PatientsWithPersonality(PWP)框架,通过在潜在患者状态上显式参数化人格特征(基于HEXACO六维人格模型),生成兼具真实性和多样性的虚拟患者响应。该方法可精细调控对话风格、合作程度与信息披露。临床评估表明,PWP被评价为几乎与真实演员同样真实,显著优于先前模拟器,且被标记为“过于信息丰富”的次数大幅减少。基于HEXACO维度构建的人格角色,其配置特质可被医生与自动评分器准确识别,行为覆盖范围远超基线,有效防止信息过载。本框架为更精准、可调控的医疗大模型评测提供了新路径。
原文摘要 · Abstract (English)
Simulating realistic patient interactions is a key requirement to testing clinical applications of LLMs at scale without time-consuming and expensive user studies. However, existing approaches often lack realism and controllability, often oversharing information unprompted, and failing to capture the wide variability of patient behavior. Here, we introduce PatientsWithPersonality (PWP), a patient simulation framework that generates realistic yet diverse virtual patient responses through explicit personality parametrization over a latent patient state. Grounded in HEXACO, a six-dimensional personality space used to quantify and parameterize human behavioral traits, our approach enables fine-grained control over conversational style, cooperativeness, and information disclosure within a unified framework. In a clinician evaluation, PWP is judged nearly as realistic as recorded human actors and clearly ahead of prior simulators, while being flagged as "too informative" far less often. Conditioning on HEXACO axes yields personas whose configured traits are recoverable by both clinicians and an autorater, span a substantially wider behavioral footprint than the closest baseline, and prevent oversharing. Altogether, our framework paves the way for more accurate and informative LLM benchmarking through our realistic and steerable patient simulator.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。