Med-TTT通过测试时训练提升医学图像分割精度,尤其擅长复杂背景下的病灶识别。
Med-TTT: Vision Test-Time Training model for Medical Image Segmentation
- 引入视觉测试时训练层,线性复杂度建模长距离依赖,推理时动态调参。
- 多尺度融合与高频滤波增强细节,显著提升小病灶识别能力。
- 在多个数据集上超越现有方法,适合临床高精度分割场景使用。
医学图像分割在临床诊断与治疗规划中至关重要。尽管基于卷积神经网络(CNN)和Transformer的模型在该任务上取得显著进展,但仍面临计算复杂度高及捕捉长程依赖时局部特征丢失的问题。为此,我们提出Med-TTT,一种集成测试时训练(TTT)层的视觉主干网络,具备动态调整能力。Med-TTT引入视觉TTT层,在推理阶段实现线性计算复杂度的长程依赖建模与自适应参数调节。此外,设计多分辨率融合机制,整合不同尺度特征,有助于在复杂背景下识别细微病灶。同时,采用基于高通滤波的频域特征增强策略,更有效捕捉图像纹理与细粒度细节。实验表明,Med-TTT在多个医学图像数据集上显著优于现有方法,尤其在复杂背景中表现突出,准确率、敏感性和Dice系数均达领先水平,为医学图像分割提供高效稳健的解决方案。代码已开源:https://github.com/Jiashu-Xu/Med-TTT。
原文摘要 · Abstract (English)
Medical image segmentation plays a crucial role in clinical diagnosis and treatment planning. Although models based on convolutional neural networks (CNNs) and Transformers have achieved remarkable success in medical image segmentation tasks, they still face challenges such as high computational complexity and the loss of local features when capturing long-range dependencies. To address these limitations, we propose Med-TTT, a visual backbone network integrated with Test-Time Training (TTT) layers, which incorporates dynamic adjustment capabilities. Med-TTT introduces the Vision-TTT layer, which enables effective modeling of long-range dependencies with linear computational complexity and adaptive parameter adjustment during inference. Furthermore, we designed a multi-resolution fusion mechanism to combine image features at different scales, facilitating the identification of subtle lesion characteristics in complex backgrounds. At the same time, we adopt a frequency domain feature enhancement strategy based on high pass filtering, which can better capture texture and fine-grained details in images. Experimental results demonstrate that Med-TTT significantly outperforms existing methods on multiple medical image datasets, exhibiting strong segmentation capabilities, particularly in complex image backgrounds. The model achieves leading performance in terms of accuracy, sensitivity, and Dice coefficient, providing an efficient and robust solution for the field of medical image segmentation.The code is available at https://github.com/Jiashu-Xu/Med-TTT .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。