UniCAD用极少量参数实现多任务医学影像诊断,高效且可扩展。
UniCAD: Efficient and Extendable Architecture for Multi-Task Computer-Aided Diagnosis System
- 用低秩适配让预训练模型快速适应医学图像,仅需0.17%参数量。
- 在12个数据集上性能超越现有方法,推理效率显著提升。
- 开源模块化平台,适合医疗AI研究者快速搭建诊断系统。
视觉模型预训练的复杂性和规模日益增加,导致多任务医学影像辅助诊断(CAD)系统的开发与部署变得愈发困难且资源消耗巨大。此外,医学影像领域缺乏一个开源的CAD平台,难以实现高效、可扩展的诊断模型快速构建。为此,我们提出UniCAD,一种统一架构,利用预训练视觉基础模型的强大能力,无缝处理二维和三维医学图像,同时仅需极少的任务特定参数。UniCAD引入两项关键创新:(1) 高效性:采用低秩适配策略将预训练视觉模型迁移到医学图像领域,在性能上媲美全微调模型的同时,仅引入0.17%的可训练参数;(2) 即插即用:采用冻结基础模型与多个即插即用专家相结合的模块化架构,支持多样化任务并实现功能无缝扩展。基于此统一架构,我们建立了开源平台,研究人员可共享与获取轻量级CAD专家,推动更公平高效的科研生态。在12个不同医学数据集上的全面实验表明,UniCAD在准确率和部署效率方面均持续优于现有方法。源代码及项目页面见https://mii-laboratory.github.io/UniCAD/。
原文摘要 · Abstract (English)
The growing complexity and scale of visual model pre-training have made developing and deploying multi-task computer-aided diagnosis (CAD) systems increasingly challenging and resource-intensive. Furthermore, the medical imaging community lacks an open-source CAD platform to enable the rapid creation of efficient and extendable diagnostic models. To address these issues, we propose UniCAD, a unified architecture that leverages the robust capabilities of pre-trained vision foundation models to seamlessly handle both 2D and 3D medical images while requiring only minimal task-specific parameters. UniCAD introduces two key innovations: (1) Efficiency: A low-rank adaptation strategy is employed to adapt a pre-trained visual model to the medical image domain, achieving performance on par with fully fine-tuned counterparts while introducing only 0.17% trainable parameters. (2) Plug-and-Play: A modular architecture that combines a frozen foundation model with multiple plug-and-play experts, enabling diverse tasks and seamless functionality expansion. Building on this unified CAD architecture, we establish an open-source platform where researchers can share and access lightweight CAD experts, fostering a more equitable and efficient research ecosystem. Comprehensive experiments across 12 diverse medical datasets demonstrate that UniCAD consistently outperforms existing methods in both accuracy and deployment efficiency. The source code and project page are available at https://mii-laboratory.github.io/UniCAD/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。