无需标签,测试时自监督微调提升医学4D图像插值效果
Test Time Training for 4D Medical Image Interpolation
- 测试时通过旋转预测或重建任务自监督微调模型
- Cardiac数据集达33.73dB,4D-Lung达34.02dB峰值信噪比
- 适用于无标注测试数据的医学图像插值与领域自适应场景
4D医学图像插值对提升临床时间分辨率和诊断精度至关重要。以往方法忽视分布偏移问题,导致在不同分布下泛化能力差。自然解决方案是将模型适配到新测试分布,但若测试输入无真实标签则无法实现。本文提出一种新颖的测试时训练框架,利用自监督机制在无标签条件下适应新分布。在每个测试视频进行帧插值前,模型基于同一实例执行自监督任务(如旋转预测或图像重建)进行训练。我们在两个公开的4D医学图像插值数据集Cardiac和4D-Lung上进行了实验,结果表明该方法在各项评估指标上均显著提升。其中,Cardiac数据集峰值信噪比达33.73dB,4D-Lung达34.02dB。本方法不仅推动了4D医学图像插值发展,也为图像分割、图像配准等领域的域适应提供了范例。
原文摘要 · Abstract (English)
4D medical image interpolation is essential for improving temporal resolution and diagnostic precision in clinical applications. Previous works ignore the problem of distribution shifts, resulting in poor generalization under different distribution. A natural solution would be to adapt the model to a new test distribution, but this cannot be done if the test input comes without a ground truth label. In this paper, we propose a novel test time training framework which uses self-supervision to adapt the model to a new distribution without requiring any labels. Indeed, before performing frame interpolation on each test video, the model is trained on the same instance using a self-supervised task, such as rotation prediction or image reconstruction. We conduct experiments on two publicly available 4D medical image interpolation datasets, Cardiac and 4D-Lung. The experimental results show that the proposed method achieves significant performance across various evaluation metrics on both datasets. It achieves higher peak signal-to-noise ratio values, 33.73dB on Cardiac and 34.02dB on 4D-Lung. Our method not only advances 4D medical image interpolation but also provides a template for domain adaptation in other fields such as image segmentation and image registration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。