arXiv:2511.00381cs.CVcs.HC2025-11

用摄像头直接抓取屏幕影像,实现无需改造医院系统的智能诊断辅助。

VisionCAD: An Integration-Free Radiology Copilot Framework

  • 通过摄像头捕捉屏幕图像,自动检测、恢复并分析医学影像。
  • 诊断准确率比原图仅降2%以内,报告生成质量相差不到1%。
  • 只需摄像头和普通电脑,适合快速部署在各类医院环境。

临床广泛使用计算机辅助诊断(CAD)系统受限于与现有医院IT系统的集成难题。本文提出VisionCAD,一种基于视觉的放射科辅助框架,通过摄像头直接从显示屏幕上捕获医学图像,绕过集成障碍。该框架采用自动化流程,对屏幕图像进行检测、恢复和分析,将摄像头获取的视觉数据转化为可用于自动化分析与报告生成的诊断级图像。我们在多种医学影像数据集上验证了VisionCAD,结果表明其模块化架构可灵活调用先进诊断模型完成特定任务。系统在分类任务中的F1分数下降通常低于2%,且自动生成报告的语言生成指标与原始图像相比差距不超过1%。仅需摄像头设备和标准计算资源,VisionCAD为人工智能辅助诊断提供了低成本部署方案,可在不改动现有基础设施的情况下推广至多样临床场景。

原文摘要 · Abstract (English)

Widespread clinical deployment of computer-aided diagnosis (CAD) systems is hindered by the challenge of integrating with existing hospital IT infrastructure. Here, we introduce VisionCAD, a vision-based radiological assistance framework that circumvents this barrier by capturing medical images directly from displays using a camera system. The framework operates through an automated pipeline that detects, restores, and analyzes on-screen medical images, transforming camera-captured visual data into diagnostic-quality images suitable for automated analysis and report generation. We validated VisionCAD across diverse medical imaging datasets, demonstrating that our modular architecture can flexibly utilize state-of-the-art diagnostic models for specific tasks. The system achieves diagnostic performance comparable to conventional CAD systems operating on original digital images, with an F1-score degradation typically less than 2\% across classification tasks, while natural language generation metrics for automated reports remain within 1\% of those derived from original images. By requiring only a camera device and standard computing resources, VisionCAD offers an accessible approach for AI-assisted diagnosis, enabling the deployment of diagnostic capabilities in diverse clinical settings without modifications to existing infrastructure.

AI辅助诊断视觉捕捉医疗信息化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。