用大模型压缩医学影像,提速70倍还保关键信息
MedVAE: Efficient Automated Interpretation of Medical Images with Large-Scale Generalizable Autoencoders
- 用六种2D/3D自编码器将医学图像转为低维特征
- 下游任务效率提升最高70倍,还原图像保真度高
- 适合需要高效处理海量医学影像的研究者
医学影像常以高分辨率、大视野采集,以捕捉临床决策所需的细微特征,但深度学习训练成本高昂。本文提出MedVAE,一套包含六种大规模2D与3D自编码器的模型家族,可将医学图像编码为低维潜在表示,并能高保真地解码回高分辨率图像。采用新型两阶段训练方法,在1,052,730张医学图像上训练。在20个不同医学图像数据集的多样化任务中验证:(1)用MedVAE潜变量替代原始高分辨率图像训练下游模型,可实现最高70倍的吞吐量提升,同时保留临床相关特征;(2)能高质量还原潜变量为高分辨率图像。本工作表明,大规模通用自编码器可有效缓解医疗领域关键的计算效率挑战。代码已开源。
原文摘要 · Abstract (English)
Medical images are acquired at high resolutions with large fields of view in order to capture fine-grained features necessary for clinical decision-making. Consequently, training deep learning models on medical images can incur large computational costs. In this work, we address the challenge of downsizing medical images in order to improve downstream computational efficiency while preserving clinically-relevant features. We introduce MedVAE, a family of six large-scale 2D and 3D autoencoders capable of encoding medical images as downsized latent representations and decoding latent representations back to high-resolution images. We train MedVAE autoencoders using a novel two-stage training approach with 1,052,730 medical images. Across diverse tasks obtained from 20 medical image datasets, we demonstrate that (1) utilizing MedVAE latent representations in place of high-resolution images when training downstream models can lead to efficiency benefits (up to 70x improvement in throughput) while simultaneously preserving clinically-relevant features and (2) MedVAE can decode latent representations back to high-resolution images with high fidelity. Our work demonstrates that large-scale, generalizable autoencoders can help address critical efficiency challenges in the medical domain. Our code is available at https://github.com/StanfordMIMI/MedVAE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。