一个模型搞定病理图像去噪、超分辨率和虚拟染色,提升质量更省成本。
A Unified Low-level Foundation Model for Enhancing Pathology Image Quality
- 用1.9亿张无标注病理图预训练编码器,学出抗染色差异的通用特征。
- 单架构支持66项任务,图像恢复PSNR提升10-15%,虚拟染色SSIM增12-18%。
- 仅需文本提示就能切换任务,适合临床科研与数字病理系统部署。
基础模型在高阶病理诊断中已取得显著成果,但低级图像增强问题仍被忽视。真实病理图像常因切片制备、染色变异和成像限制导致噪声、模糊、低分辨率等退化。现有方法多针对单一任务如去噪或超分辨,缺乏通用性。为此,我们提出首个统一的低级病理基础模型(LPFM),可同时完成超分辨率、去模糊、去噪及虚拟染色(H&E与特殊染色)等任务。模型基于1.9亿张未标注病理图像预训练对比编码器,学习可迁移的染色无关特征表示,有效识别退化模式;采用统一条件扩散过程,通过文本提示动态适配任务,实现精确输出控制。在包含34种组织类型、5种染色方案的87,810张全切片图像(WSIs)数据集上训练,LPFM在56/66项任务中显著优于现有方法(p<0.01),图像恢复的峰值信噪比(PSNR)提升10-15%,虚拟染色的结构相似性指数(SSIM)提高12-18%。
原文摘要 · Abstract (English)
Foundation models have revolutionized computational pathology by achieving remarkable success in high-level diagnostic tasks, yet the critical challenge of low-level image enhancement remains largely unaddressed. Real-world pathology images frequently suffer from degradations such as noise, blur, and low resolution due to slide preparation artifacts, staining variability, and imaging constraints, while the reliance on physical staining introduces significant costs, delays, and inconsistency. Although existing methods target individual problems like denoising or super-resolution, their task-specific designs lack the versatility to handle the diverse low-level vision challenges encountered in practice. To bridge this gap, we propose the first unified Low-level Pathology Foundation Model (LPFM), capable of enhancing image quality in restoration tasks, including super-resolution, deblurring, and denoising, as well as facilitating image translation tasks like virtual staining (H&E and special stains), all through a single adaptable architecture. Our approach introduces a contrastive pre-trained encoder that learns transferable, stain-invariant feature representations from 190 million unlabeled pathology images, enabling robust identification of degradation patterns. A unified conditional diffusion process dynamically adapts to specific tasks via textual prompts, ensuring precise control over output quality. Trained on a curated dataset of 87,810 whole slied images (WSIs) across 34 tissue types and 5 staining protocols, LPFM demonstrates statistically significant improvements (p<0.01) over state-of-the-art methods in most tasks (56/66), achieving Peak Signal-to-Noise Ratio (PSNR) gains of 10-15% for image restoration and Structural Similarity Index Measure (SSIM) improvements of 12-18% for virtual staining.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。