arXiv:2505.09380cs.CVcs.AI2025-05被引 3

通过实时反馈优化脑出血AI模型,诊断准确率显著提升。

Examining Deployment and Refinement of the VIOLA-AI Intracranial Hemorrhage Model Using an Interactive NeoMedSys Platform

  • 构建交互式平台实现AI模型持续迭代优化
  • 敏感度从79.2%升至90.3%,特异度达89.3%
  • 适合临床医生参与AI模型改进的团队使用

背景:放射科中人工智能工具的临床部署面临诸多挑战与机遇。本研究描述了一款名为NeoMedSys的放射科软件平台,可实现AI模型的高效部署与优化。我们评估了该平台在真实临床环境中运行三个月的可行性与有效性,并聚焦于一款自研的颅内出血(ICH)检测AI模型(VIOLA-AI)的性能改进。方法:NeoMedSys集成网页版医学影像查看器、标注系统及全院放射信息系统,支持模型部署、测试与优化。前瞻性实用研究在挪威最大急诊科(站点1)疑似创伤性脑损伤患者及疑似卒中患者(站点2)中开展。通过敏感度、特异度、准确率及受试者工作特征曲线下面积(AUC)评估模型在新数据输入与计划内重训练后的表现。结果:NeoMedSys促进了模型的迭代改进,显著提升诊断准确性。自动出血检测与分割在近实时下被审查,用于重训练VIOLA-AI。迭代优化使分类敏感度提升至90.3%(从79.2%),特异度达到89.3%(从80.7%)。整体样本的出血检测ROC分析显示高AUC值为0.949(从0.873)。模型优化阶段伴随显著性能提升,凸显实时放射科医生反馈的价值。

原文摘要 · Abstract (English)

Background: There are many challenges and opportunities in the clinical deployment of AI tools in radiology. The current study describes a radiology software platform called NeoMedSys that can enable efficient deployment and refinements of AI models. We evaluated the feasibility and effectiveness of running NeoMedSys for three months in real-world clinical settings and focused on improvement performance of an in-house developed AI model (VIOLA-AI) designed for intracranial hemorrhage (ICH) detection. Methods: NeoMedSys integrates tools for deploying, testing, and optimizing AI models with a web-based medical image viewer, annotation system, and hospital-wide radiology information systems. A prospective pragmatic investigation was deployed using clinical cases of patients presenting to the largest Emergency Department in Norway (site-1) with suspected traumatic brain injury (TBI) or patients with suspected stroke (site-2). We assessed ICH classification performance as VIOLA-AI encountered new data and underwent pre-planned model retraining. Performance metrics included sensitivity, specificity, accuracy, and the area under the receiver operating characteristic curve (AUC). Results: NeoMedSys facilitated iterative improvements in the AI model, significantly enhancing its diagnostic accuracy. Automated bleed detection and segmentation were reviewed in near real-time to facilitate re-training VIOLA-AI. The iterative refinement process yielded a marked improvement in classification sensitivity, rising to 90.3% (from 79.2%), and specificity that reached 89.3% (from 80.7%). The bleed detection ROC analysis for the entire sample demonstrated a high area-under-the-curve (AUC) of 0.949 (from 0.873). Model refinement stages were associated with notable gains, highlighting the value of real-time radiologist feedback.

AI辅助诊断脑出血检测模型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。