提出新模型与数据集,提升心脏超声视频视图自动分类准确率。
Spatio-Temporal Fusion Model for Standard View Classification of Echocardiographic Videos

- 设计双流CNN-LSTM模型,融合解剖结构与心脏动态信息。
- 在5138个视频上达到92.3%准确率,优于现有方法。
- 适合医学影像分析、临床辅助诊断方向的研究者使用。
自动化分类标准心脏超声视图对提高临床效率至关重要,但面临三大挑战:公开数据集稀缺且规模小、覆盖视图有限;部分先进视频模型在超声分类中的性能尚不明确;部分视图空间外观高度相似,单帧特征难以区分,且帧质量差异大,影响时序信息融合。为此,我们发布超声视频九视图数据集(EV9V),包含5,138个视频、910,579帧和9种标准视图,是目前已知最大公开超声视频数据集。基于EV9V,我们系统性评估了代表性视频分类架构,包括卷积神经网络(CNN)、循环神经网络(RNN)和Transformer。同时提出时空融合模型(STFM),一种高效的双流CNN-LSTM框架,联合捕捉空间解剖结构与时间心脏动态。该模型采用不确定性感知学习,在训练中优先选择代表性视频片段,在推理时进行证据融合,提升对帧质量差异的鲁棒性。大量实验表明,该方法在多种视频分类模型上均表现优异,验证了不确定性感知时空学习的有效性。代码已开源。
原文摘要 · Abstract (English)
Automated classification of standard echocardiographic views is crucial for efficient clinical workflow but faces three main challenges. First, publicly available datasets are scarce and limited in scale and view coverage. Second, the performance of some modern video-level architectures for echocardiographic view classification remains underexplored. Third, some view categories exhibit highly similar spatial appearances, making single-frame features insufficient for discrimination, while heterogeneous frame quality complicates robust temporal information fusion. To address these challenges, we release the Echocardiographic Videos of Nine Views (EV9V) dataset, comprising 5,138 videos, 910,579 frames, and 9 standard views, which is, to the best of our knowledge, the largest publicly available echocardiography video dataset. Using EV9V, we systematically benchmark representative video classification architectures, including Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), and Transformers. Furthermore, we propose a Spatio-Temporal Fusion Model (STFM), an efficient dual-stream CNN-LSTM (Long Short-Term Memory) framework that jointly captures spatial anatomical structures and temporal cardiac dynamics. The proposed framework leverages uncertainty-aware learning to preferentially sample representative video segments during training and evidence-based fusion during inference, improving robustness to variations in frame quality across echocardiographic videos. Extensive experiments demonstrate that our method achieves competitive performance across diverse video classification models, validating the effectiveness of uncertainty-aware spatio-temporal learning for echocardiographic view classification. The code is available at https://github.com/bgx666/stfm.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。