arXiv:2509.12534eess.IVcs.AI2025-09中稿 · the Conference on …被引 4

用AI自动生成眼底图报告,提升诊断效率与准确性。

DeepEyeNet: Generating Medical Report for Retinal Images

  • 融合图像与文本的多模态深度学习生成报告。
  • 在EyeQ、AMD-2021等数据集上表现领先。
  • 提升报告可解释性,适合临床医生辅助使用。

眼底疾病发病率上升,眼科医生数量不足,导致诊断延迟。传统人工报告耗时且易出错。本文研究利用人工智能自动生成眼底图像医学报告,以提高诊断效率。提出四种关键技术:(1) 多模态深度学习捕捉图像与关键词的交互关系;(2) 改进医学关键词表示方法,更准确表达术语细节;(3) 克服RNN模型在长序列描述中的依赖性局限;(4) 提升系统可解释性,增强临床信任。在EyeQ、AMD-2021等多个数据集上验证,性能达到当前最优水平。结果表明,该AI系统可显著提升诊断效率与准确性,改善患者护理质量。

原文摘要 · Abstract (English)

The increasing prevalence of retinal diseases poses a significant challenge to the healthcare system, as the demand for ophthalmologists surpasses the available workforce. This imbalance creates a bottleneck in diagnosis and treatment, potentially delaying critical care. Traditional methods of generating medical reports from retinal images rely on manual interpretation, which is time-consuming and prone to errors, further straining ophthalmologists' limited resources. This thesis investigates the potential of Artificial Intelligence (AI) to automate medical report generation for retinal images. AI can quickly analyze large volumes of image data, identifying subtle patterns essential for accurate diagnosis. By automating this process, AI systems can greatly enhance the efficiency of retinal disease diagnosis, reducing doctors' workloads and enabling them to focus on more complex cases. The proposed AI-based methods address key challenges in automated report generation: (1) A multi-modal deep learning approach captures interactions between textual keywords and retinal images, resulting in more comprehensive medical reports; (2) Improved methods for medical keyword representation enhance the system's ability to capture nuances in medical terminology; (3) Strategies to overcome RNN-based models' limitations, particularly in capturing long-range dependencies within medical descriptions; (4) Techniques to enhance the interpretability of the AI-based report generation system, fostering trust and acceptance in clinical practice. These methods are rigorously evaluated using various metrics and achieve state-of-the-art performance. This thesis demonstrates AI's potential to revolutionize retinal disease diagnosis by automating medical report generation, ultimately improving clinical efficiency, diagnostic accuracy, and patient care.

医学报告生成多模态学习眼底图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。