无需配对数据,用Transformer提升胶囊内镜图像分辨率
UnCapsTSR: An Unsupervised Transformer-based Image Super-Resolution Approach for Capsule Endoscopy Images

- 基于Transformer的无监督GAN框架,不依赖真实低清-高清图像对
- 在多个数据集上使图像质量评分提升40%至80%(新指标EndoQM)
- 专为胶囊内镜设计,适合医疗图像增强与医学影像研究者
无线胶囊内镜(WCE)通过患者消化道时拍摄并传输视频,用于检查异常。尽管优于传统内镜,但受限于胶囊尺寸和无线传输,图像分辨率较低。本文提出UnCapsTSR,一种基于Transformer的无监督生成对抗网络框架,用于提升低分辨率(LR)WCE图像的空间分辨率。该方法无需显式估计真实低分辨率数据的退化过程,也无需真实低清-高清图像对。UnCapsTSR采用双边总变差(BTV)损失,确保超分辨率图像的空间连续性。同时,本文构建了一个新数据集,基于Kvasir Capsule数据集用于训练。泛化能力在未参与训练的KID和GIANA数据集上得到验证。引入新的非参考指标——内镜质量度量(EndoQM),用于评估特定领域WCE数据。实验表明,相比现有最先进的无监督超分辨率方法,在NIQE、BRISQUE、PIQE和EndoQM上均有持续提升。统计分析显示,从低分辨率到超分辨率,各数据集上的EndoQM提升达40%至80%。
原文摘要 · Abstract (English)
Wireless Capsule Endoscopy (WCE) captures and streams video while passing through a patient's Gastrointestinal (GI) tract and is used to examine its irregularities. Although advantageous over conventional endoscopy, WCE suffers from limitations related to capsule size and wireless transmission, resulting in images with coarser resolution. This work presents UnCapsTSR, an unsupervised transformer-based Generative Adversarial Network (GAN) framework for improving the spatial resolution of Low-Resolution (LR) WCE images. The proposed method accomplishes SR without explicit degradation estimation of real-world LR data and eliminates the need for true LR-HR pairs. UnCapsTSR employs a Bilateral Total Variation (BTV) loss to ensure spatial continuity in SR images. A newly curated dataset from the Kvasir Capsule dataset is also presented for training WCE SR models. Generalizability is validated on KID and GIANA datasets that are not used during training. A new non-reference metric, Endoscopy Quality Metric (EndoQM), is introduced for quantitative evaluation of domain-specific WCE data. Experiments demonstrate consistent improvement over state-of-the-art unsupervised SR approaches using NIQE, BRISQUE, PIQE, and EndoQM. Statistical evaluation shows 40 to 80 percent improvement in EndoQM from LR to SR across the evaluated datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。