用患者留言训练AI,自动生成贴近真实需求的医学研究课题。
Can Artificial Intelligence Generate Quality Research Topics Reflecting Patient Concerns?
- 基于61万条患者留言构建两阶段无监督主题模型,提炼临床关切点。
- 用ChatGPT-4o生成研究课题,三分之一获专家评为高创新性和重要性。
- 适合关注患者中心研究、医疗AI应用的研究者与临床决策者。
以患者为中心的研究对弥合科研与临床实践差距至关重要,但患者意见融入研究仍不一致。本文提出一种自动化框架,利用自然语言处理与人工智能技术,基于大型学术医院2013至2024年间25,549名乳腺癌或皮肤癌患者发送的614,464条门户消息,生成反映患者核心关切的研究课题。通过两阶段无监督NLP主题建模识别患者临床关切,并使用ChatGPT-4o(OpenAI,2024年4月版)结合提示工程策略,引导AI完成知识解读、研究构想、自我反思修正及最终确认四步任务。六位资深乳腺肿瘤科与皮肤科医生采用五级李克特量表评估生成课题的重要性与新颖性。结果显示,三分之一的课题在两项评分上均优于平均值,三分之二的课题在两类癌症中均具新颖性。研究证明,基于大量患者留言的AI生成课题能有效指引患者中心型健康研究的未来方向。
原文摘要 · Abstract (English)
Patient-centered research is increasingly important in narrowing the gap between research and patient care, yet incorporating patient perspectives into health research has been inconsistent. We propose an automated framework leveraging innovative natural language processing (NLP) and artificial intelligence (AI) with patient portal messages to generate research ideas that prioritize important patient issues. We further quantified the quality of AI-generated research topics. To define patient clinical concerns, we analyzed 614,464 patient messages from 25,549 individuals with breast or skin cancer obtained from a large academic hospital (2013 to 2024), constructing a 2-staged unsupervised NLP topic model. Then, we generated research topics to resolve the defined issues using a widely used AI (ChatGPT-4o, OpenAI Inc, April 2024 version) with prompt-engineering strategies. We guided AI to perform multi-level tasks: 1) knowledge interpretation and summarization (e.g., interpreting and summarizing the NLP-defined topics), 2) knowledge generation (e.g., generating research ideas corresponding to patients issues), 3) self-reflection and correction (e.g., ensuring and revising the research ideas after searching for scientific articles), and 4) self-reassurance (e.g., confirming and finalizing the research ideas). Six highly experienced breast oncologists and dermatologists assessed the significance and novelty of AI-generated research topics using a 5-point Likert scale (1-exceptional, 5-poor). One-third of the AI-suggested research topics were highly significant and novel when both scores were lower than the average. Two-thirds of the AI-suggested topics were novel in both cancers. Our findings demonstrate that AI-generated research topics reflecting patient perspectives via a large volume of patient messages can meaningfully guide future directions in patient-centered health research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。