arXiv:2603.04565cs.CV2026-03

用双LoRA扩散模型统一完成病理图像修复与生成,提升结构真实度。

Structure-Guided Histopathology Synthesis via Dual-LoRA Diffusion

  • 以细胞核中心点为轻量级空间先验,指导局部修复和全局生成
  • 局部修复的LPIPS降为0.1524,全局生成的FID降至76.04,结构更真实
  • 无需训练多个模型,适合癌症病理图像的大规模建模应用

病理图像合成在组织修复、数据增强和肿瘤微环境建模中具有重要意义。现有生成方法通常将修复与生成分开展示,尽管两者目标一致:在不同程度缺失下实现结构一致的组织合成,且常依赖弱或不一致的结构先验,限制了细胞组织的真实性。我们提出双LoRA可控扩散模型,一个统一的中心点引导框架,可在一个模型中同时支持局部结构补全与全局结构生成。多类细胞核中心点作为轻量、标注高效的时空先验,在部分或完全缺失情况下提供生物学意义明确的指导。两个任务专用的LoRA适配器使共享主干分别适配局部与全局目标,无需重新训练独立扩散模型。大量实验表明,该方法在修复与生成任务上均优于当前最优的GAN与扩散基线。局部补全中,掩码区域内的LPIPS从0.1797(HARP)降至0.1524;全局生成中,FID从225.15(CoSys)降至76.04,表明结构保真度与真实性显著提升。本方法在掩码区域实现更忠实的结构恢复,并在完整生成中大幅提升真实感与形态一致性,支持可扩展的泛癌病理建模。

原文摘要 · Abstract (English)

Histopathology image synthesis plays an important role in tissue restoration, data augmentation, and modeling of tumor microenvironments. However, existing generative methods typically address restoration and generation as separate tasks, although both share the same objective of structure-consistent tissue synthesis under varying degrees of missingness, and often rely on weak or inconsistent structural priors that limit realistic cellular organization. We propose Dual-LoRA Controllable Diffusion, a unified centroid-guided diffusion framework that jointly supports Local Structure Completion and Global Structure Synthesis within a single model. Multi-class nuclei centroids serve as lightweight and annotation-efficient spatial priors, providing biologically meaningful guidance under both partial and complete image absence. Two task-specific LoRA adapters specialize the shared backbone for local and global objectives without retraining separate diffusion models. Extensive experiments demonstrate consistent improvements over state-of-the-art GAN and diffusion baselines across restoration and synthesis tasks. For local completion, LPIPS computed within the masked region improves from 0.1797 (HARP) to 0.1524, and for global synthesis, FID improves from 225.15 (CoSys) to 76.04, indicating improved structural fidelity and realism. Our approach achieves more faithful structural recovery in masked regions and substantially improved realism and morphology consistency in full synthesis, supporting scalable pan-cancer histopathology modeling.

病理图像扩散模型结构生成双LoRA

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。