用流形匹配生成病理图像,解决条件崩溃问题。
STREAM: Stochastic Riemannian Flow Matching with Anisotropic Decoder for Digital Histopathology Image Generation

- 将病理特征作为流形空间,用随机流匹配建模图像生成
- 在乳腺和结直肠癌数据集上达到生成与重建最优性能
- 适合需要高质量合成病理图像的研究者使用
合成病理图像生成解决了计算病理学中的患者隐私和大规模训练数据需求问题。现有主流方法依赖预训练视觉基础模型(VFMs)作为条件信号,但导致‘条件崩溃’,使生成样本质量与多样性下降。本文提出将预训练病理学VFMs的补丁-令牌特征直接作为潜在空间,这些特征经实证为ℓ₂归一化,位于单位超球面𝒮^{d−1},具有强角度主导性和内在曲率,天然适合黎曼几何建模。为此,我们提出首个应用于病理领域的黎曼流匹配框架STREAM,包含两阶段:1)桥式随机扰动,在𝒮^{d−1}上建立逐令牌可平直化,用于训练扩散Transformer(DiT);2)新型各向异性解码器,增强速度场雅可比低能量方向的鲁棒性,同时保持高能量方向保真度。STREAM在乳腺癌和结直肠癌数据集上实现生成与重建的最先进表现。代码将在录用后公开。
原文摘要 · Abstract (English)
Synthetic histopathology image generation addresses critical challenges in computational pathology, including patient privacy and the growing need for large-scale training data for foundation models. Latent diffusion models have dominated the image generation domain, with recent works emphasizing that the choice of latent space is critical to the quality of generated images. Existing state-of-the-art generative models in histopathology use pretrained Vision Foundation Models (VFMs) as conditioning signals, and we observe that this leads to "conditioning collapse," where the conditioning signal dominates the latent space and lowers the quality and diversity of generated samples. Therefore, we instead use pretrained histopathology VFMs as the latent space itself, leveraging their patch-token features that encode rich semantic information. We empirically show that these features are $\ell_2$-normalized and lie on the unit hypersphere $\mathcal{S}^{d-1}$ with strong angular dominance and intrinsic curvature, making them naturally suited for a Riemannian formulation. We therefore present STREAM, the first framework to apply Riemannian flow matching in the pathology domain. STREAM consists of two stages: 1) a bridge-type stochastic perturbation that establishes per-token rectifiability on $\mathcal{S}^{d-1}$ for training a Diffusion Transformer (DiT) in latent space, and 2) a novel anisotropic decoder that allocates robustness to low-energy directions of the velocity-field Jacobian while preserving fidelity along its high-energy directions. Together, STREAM achieves state-of-the-art reconstruction and generation performance on breast and colorectal cancer datasets. The code will be publicly released upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。