用小波与Transformer融合提升病理切片超分辨率效果
CWT-Net: Super-resolution of Histopathology Images Using a Cross-scale Wavelet-based Transformer
- 结合小波变换与Transformer,双分支学习图像与高频特征
- 在Camelyon16数据集上PSNR提升1.2dB,视觉质量更优
- 适合需要高精度病理图像分析的研究者使用
超分辨率(SR)旨在提升低分辨率图像质量,在医学影像中广泛应用。现有方法多受真实世界图像SR任务影响,未充分考虑病理图像的多层次结构特性,尽管客观指标尚可。本文深入分析两种超分辨率范式,提出CWT-Net,融合跨尺度小波变换与Transformer架构。网络包含双分支:一专用于超分辨率重建,另一专注高阶小波特征提取。通过多阶段共享与融合两分支特征,实现高质量重建。设计专用小波重构模块,有效增强小波域特征,并支持多种运行模式,可引入跨尺度辅助信息。实验表明,本模型在性能与视觉评估上均显著优于当前最优方法,且能明显提升诊断网络的准确率。
原文摘要 · Abstract (English)
Super-resolution (SR) aims to enhance the quality of low-resolution images and has been widely applied in medical imaging. We found that the design principles of most existing methods are influenced by SR tasks based on real-world images and do not take into account the significance of the multi-level structure in pathological images, even if they can achieve respectable objective metric evaluations. In this work, we delve into two super-resolution working paradigms and propose a novel network called CWT-Net, which leverages cross-scale image wavelet transform and Transformer architecture. Our network consists of two branches: one dedicated to learning super-resolution and the other to high-frequency wavelet features. To generate high-resolution histopathology images, the Transformer module shares and fuses features from both branches at various stages. Notably, we have designed a specialized wavelet reconstruction module to effectively enhance the wavelet domain features and enable the network to operate in different modes, allowing for the introduction of additional relevant information from cross-scale images. Our experimental results demonstrate that our model significantly outperforms state-of-the-art methods in both performance and visualization evaluations and can substantially boost the accuracy of image diagnostic networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。