arXiv:2410.00441cs.AIeess.IV2024-10AAAI被引 9

用AI把专业放射科报告转成通俗易懂的视频,让患者看懂检查结果。

ReXplain: Translating Radiology into Patient-Friendly Video Reports

  • 用大模型简化医学文本并关联解剖结构
  • 结合图像分割和3D渲染生成可视化视频
  • 适合希望提升医患沟通效率的医疗机构

放射科报告虽便于医生间交流,却常令患者难以理解,可能引发焦虑、降低治疗参与度,影响健康结局。我们提出ReXplain(Radiology eXplanation),一种基于AI的创新系统,将放射学发现转化为面向患者的友好型视频报告。该系统整合大型语言模型进行医学文本简化与解剖关联、图像分割模型识别解剖区域,以及头像生成工具实现交互式可视化。ReXplain可生成包含通俗语言、高亮图像与3D器官渲染的完整视频解释。通过两次收集六名认证放射科医师的反馈,本概念验证研究显示,ReXplain能准确传达放射学信息,并有效模拟一对一咨询,为以患者为中心的放射科实践提供新范式,具有潜在临床应用价值。

原文摘要 · Abstract (English)

Radiology reports, designed for efficient communication between medical experts, often remain incomprehensible to patients. This inaccessibility could potentially lead to anxiety, decreased engagement in treatment decisions, and poorer health outcomes, undermining patient-centered care. We present ReXplain (Radiology eXplanation), an innovative AI-driven system that translates radiology findings into patient-friendly video reports. ReXplain uniquely integrates a large language model for medical text simplification and text-anatomy association, an image segmentation model for anatomical region identification, and an avatar generation tool for engaging interface visualization. ReXplain enables producing comprehensive explanations with plain language, highlighted imagery, and 3D organ renderings in the form of video reports. To evaluate the utility of ReXplain-generated explanations, we conducted two rounds of user feedback collection from six board-certified radiologists. The results of this proof-of-concept study indicate that ReXplain could accurately deliver radiological information and effectively simulate one-on-one consultation, shedding light on enhancing patient-centered radiology with potential clinical usage. This work demonstrates a new paradigm in AI-assisted medical communication, potentially improving patient engagement and satisfaction in radiology care, and opens new avenues for research in multimodal medical communication.

医疗AI多模态患者沟通

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。