用解剖结构约束变压器模型,提升心肌淀粉样变分类准确率
Anatomically Constrained Transformers for Cardiac Amyloidosis Classification
- 将心肌区域建模为可变形点与图像块,作为输入令牌
- 在心肌区域上训练和预训练,分类性能优于全视频模型
- 可可视化注意力分布,确保模型关注临床相关区域
心脏淀粉样变性(CA)是一种罕见的心肌病,典型特征是超声心动图中心肌全局纵向应变降低。传统神经网络方法使用卷积神经网络处理完整视频片段,但无法保证分类基于临床相关特征。本文提出一种新范式:将变压器模型显式约束于已知异常发生的解剖区域——心肌。通过将心肌建模为一组可变形点及其对应采样图像块,作为输入令牌。该约束还可应用于流行的自监督学习掩码自动编码器预训练,仅对解剖区域内的图像块进行掩码与重建。实验证明,将变压器和预训练任务均限定在心肌区域后,相较于全视频变压器,分类性能显著提升。模型确保分类聚焦于超声图像中的特定解剖区域,并支持在动态心肌上可视化注意力得分。
原文摘要 · Abstract (English)
Cardiac amyloidosis (CA) is a rare cardiomyopathy, with typical abnormalities in clinical measurements from echocardiograms such as reduced global longitudinal strain of the myocardium. An alternative approach for detecting CA is via neural networks, using video classification models such as convolutional neural networks. These models process entire video clips, but provide no assurance that classification is based on clinically relevant features known to be associated with CA. An alternative paradigm for disease classification is to apply models to quantitative features such as strain, ensuring that the classification relates to clinically relevant features. Drawing inspiration from this approach, we explicitly constrain a transformer model to the anatomical region where many known CA abnormalities occur -- the myocardium, which we embed as a set of deforming points and corresponding sampled image patches into input tokens. We show that our anatomical constraint can also be applied to the popular self-supervised learning masked autoencoder pre-training, where we propose to mask and reconstruct only anatomical patches. We show that by constraining both the transformer and pre-training task to the myocardium where CA imaging features are localized, we achieve increased performance on a CA classification task compared to full video transformers. Our model provides an explicit guarantee that the classification is focused on only anatomical regions of the echo, and enables us to visualize transformer attention scores over the deforming myocardium.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。