用小波分析与记忆库追踪超声长视频中的细节,提升小病灶分割精度。
Tracking spatial temporal details in ultrasound long video via wavelet analysis and memory bank
- 通过小波卷积和记忆库融合多尺度高频特征,增强边界细节捕捉能力。
- 在4个超声数据集上显著提升小甲状腺结节分割准确率,降低边界误差。
- 适合需要高精度长期视频跟踪的医学影像分析场景,如手术规划。
医学超声视频广泛用于体检、疾病诊断和手术规划。高保真病变区域与目标器官分割是计算机辅助手术流程的关键。由于超声视频对比度低、背景噪声大,易导致器官边界误分割,造成小目标丢失及边界误差增大。长视频目标跟踪仍是重大挑战。为此,我们提出基于记忆库的小波滤波与融合网络,采用编码器-解码器结构,有效提取细粒度空间特征并整合高频(HF)信息。具体而言,记忆小波卷积在编码器中同时捕捉类别、细节信息并利用邻域信息;级联小波压缩用于融合多尺度频域特征,并扩展每层卷积的感受野;设计基于长短期记忆库的跨注意力与记忆压缩机制,实现长视频目标跟踪。为充分挖掘特征图的边界敏感高频细节,解码器中引入自适应小波滤波器的高频感知特征融合模块。在四个超声视频数据集(两个甲状腺结节、甲状腺腺体、心脏数据集)上的大量基准测试表明,该方法在分割指标上显著优于现有最先进方法。尤其在小甲状腺结节分割上表现更优,验证了其在长视频中小超声目标处理中的有效性。代码已开源:https://github.com/XiAooZ/MWNet。
原文摘要 · Abstract (English)
Medical ultrasound videos are widely used for medical inspections, disease diagnosis and surgical planning. High-fidelity lesion area and target organ segmentation constitutes a key component of the computer-assisted surgery workflow. The low contrast levels and noisy backgrounds of ultrasound videos cause missegmentation of organ boundary, which may lead to small object losses and increase boundary segmentation errors. Object tracking in long videos also remains a significant research challenge. To overcome these challenges, we propose a memory bank-based wavelet filtering and fusion network, which adopts an encoder-decoder structure to effectively extract fine-grained detailed spatial features and integrate high-frequency (HF) information. Specifically, memory-based wavelet convolution is presented to simultaneously capture category, detailed information and utilize adjacent information in the encoder. Cascaded wavelet compression is used to fuse multiscale frequency-domain features and expand the receptive field within each convolutional layer. A long short-term memory bank using cross-attention and memory compression mechanisms is designed to track objects in long video. To fully utilize the boundary-sensitive HF details of feature maps, an HF-aware feature fusion module is designed via adaptive wavelet filters in the decoder. In extensive benchmark tests conducted on four ultrasound video datasets (two thyroid nodule, the thyroid gland, the heart datasets) compared with the state-of-the-art methods, our method demonstrates marked improvements in segmentation metrics. In particular, our method can more accurately segment small thyroid nodules, demonstrating its effectiveness for cases involving small ultrasound objects in long video. The code is available at https://github.com/XiAooZ/MWNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。