arXiv:2607.25393cs.CV2026-07中稿 · ACMMM2026 Main Tra…

用专家指导迭代优化数据与模型,提升病理染色转换的准确性和可解释性。

Towards Reliable Stain Transfer: An Iterative Data-Model Co-Optimization Framework Based on Multimodal Expert-Guided Assessment

论文配图:Towards Reliable Stain Transfer: An Iterative Data-Model Co-Optimization Framework Based on Multimodal Expert-Guided Assessment
图 1 · 摘自论文原文
  • 通过数据-模型协同迭代,自动优化训练样本和模型性能
  • 在多个组织和生物标志物上达到当前最优精度,结构与病理一致性好
  • 首创基于病理推理的视觉语言评估工具,适合病理AI研发者使用

组织病理学检查主要依赖苏木精-伊红(H&E)和免疫组化(IHC)染色。尽管IHC提供关键分子信息,但成本高且需专业技能。染色转换可通过计算生成IHC图像替代,但面临异质生物标志物下统一、可解释建模的挑战,且缺乏像素对齐的监督信号。本文提出DMCoStain框架,一种用于染色转换的数据-模型协同优化方法。它通过迭代优化训练数据与模型能力,提升染色结果在病理与结构上的一致性。为实现临床意义明确的数据筛选,引入多模态专家引导细选策略(MEGFS),该策略基于首个基于病理表达的视觉语言模型(IPE-VLM),模拟病理科医生推理过程。为此构建了首个大规模的IPE指令跟随数据集ImmunoInstruction,包含15万条问答样本。在多个组织和生物标志物上的实验表明,DMCoStain达到当前最优性能。该范式具有强实用性,MEGFS亦可作为未来模型开发的专用评估工具。代码与数据详见:https://github.com/SikangSHU/DMCoStain。

原文摘要 · Abstract (English)

Histopathological examination primarily relies on hematoxylin and eosin (H&E) and immunohistochemistry (IHC) staining. Although IHC provides critical molecular information, it is costly and requires specialized expertise. Stain transfer provides an efficient alternative by computationally generating IHC from H&E images, but remains challenged by unified and interpretable modeling for heterogeneous biomarkers under pixel-unaligned supervision. We propose DMCoStain, a novel Data-Model Co-optimization framework for Stain transfer. It iteratively co-refines training data and model capability, improving staining accuracy and interpretability in both pathological and structural consistency. To refine training data in a clinically meaningful manner, it incorporates the Multimodal Expert-Guided Finer Selection (MEGFS) strategy, built upon a pioneering IHC-positive-expression (IPE) vision-language model (VLM) that emulates pathologist reasoning. To support MEGFS, we construct ImmunoInstruction, the first large-scale IPE instruction-following dataset with 150K VQA samples. Extensive experiments on multiple tissues and biomarkers demonstrate that DMCoStain achieves state-of-the-art (SOTA) accuracy. This paradigm offers strong practical value, and MEGFS also functions as a specialized evaluation tool for future model development. Dataset, code, and more details are in https://github.com/SikangSHU/DMCoStain.

染色转换视觉语言模型病理AI数据优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。