用缩放定律优化心脏超声模型,大幅减少参数量仍保持高精度。
Compute-Optimal Network Design for Echocardiography Myocardial Segmentation and Perfusion Quantification using Neural Scaling Laws

- 基于缩放定律预测模型性能,自动选择最优网络规模。
- 在小数据集上实现顶尖效果,参数量减少240倍。
- 分割结果媲美资深心脏病医生,适合医疗影像轻量化部署。
对比增强超声心动图可提供无辐射的床旁心肌灌注定量方法,但临床应用受限于手动标注耗时。由于领域内训练数据稀缺,自动化分割一直具有挑战性。本文借鉴大语言模型的优化策略,利用神经缩放定律预测心肌分割模型在CAMUS超声心动图数据集和25例对比增强超声(CEUS)数据集上的性能。通过外推子集表现,确定了最优网络规模,并验证其临床价值:与资深心脏病医生评估的灌注参数相比,自动分割结果相当。基于缩放定律的外推能有效预测全数据集测试损失,使模型在保持领先性能的同时,参数量减少240倍。缩放律梯度从CAMUS数据集迁移至CEUS数据集,存在预测偏差。研究证实神经缩放定律是小影像数据集下实现计算最优模型设计的实用工具。
原文摘要 · Abstract (English)
Myocardial perfusion quantification using contrast-enhanced ultrasound offers a bedside non-ionizing alternative to nuclear imaging modalities. However, its clinical adoption is hindered by time-consuming manual labelling. Automated segmentation has proved challenging due to a paucity of in-domain training data. Adapting strategies currently used to optimise large language models for large datasets, we apply neural scaling laws to predict network performance for myocardial segmentation. We extrapolate performance on subsets of the data to determine optimal network size on the CAMUS echocardiography dataset and a 25-patient contrast-enhanced ultrasound (CEUS) dataset. Finally, we validate the clinical utility of our models by comparing the final myocardial perfusion parameters with those obtained by a senior cardiologist. Extrapolation based on the scaling law is predictive of test loss at the full dataset size, allowing us to select two networks that obtained state-of-the-art performance on CAMUS with a 240-fold reduction in parameter count. We observe the gradient of the scaling law transfers from CAMUS to the CEUS dataset with a bias in the predicted losses. The automatically segmented masks perform equivalently to a senior cardiologist in myocardial perfusion quantification. These results establish neural scaling laws as a practical tool for data-driven compute-optimal model design for small imaging datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。