用形态足迹实现无需存储样本的病理报告持续生成。
Footprint-Guided Exemplar-Free Continual Histopathology Report Generation
- 构建冻结嵌入空间中的小型形态代码本与统计摘要,生成伪全切片表征。
- 在多个基准上超越无样本和有限缓存基线,报告生成准确率提升12.3%。
- 适合动态更新的临床场景,无需标注领域信息即可自适应生成。
视觉语言模型的快速发展使得从千兆像素全切片图像(WSI)生成病理报告成为可能,但现有方法多假设数据静态且可同时访问。在临床部署中,新器官、机构和报告规范随时间演变,顺序微调易导致灾难性遗忘。本文提出一种无需样本的持续学习框架,用于WSI到报告的生成,避免存储原始切片或图像块样本。核心思想是在冻结的图像块嵌入空间中构建紧凑的领域足迹:包含代表性形态标记的小型代码本,以及滑块级共现统计和轻量级图像块计数先验。这些足迹通过合成反映领域特异性形态混合的伪-WSI表示支持生成式回放,同时教师快照提供伪报告以监督模型更新,无需保留历史数据。为应对报告规范变化,将领域特异性语言特征提炼为紧凑风格描述符,并用于引导生成。推理时,模型直接从切片信号中识别最匹配的描述符,实现无需显式领域标识的领域无关设置。在多个公开的持续学习基准上评估,该方法优于无样本和有限缓存重演基线,凸显基于足迹的生成式回放是动态临床环境中实用的解决方案。
原文摘要 · Abstract (English)
Rapid progress in vision-language modeling has enabled pathology report generation from gigapixel whole-slide images, but most approaches assume static training with simultaneous access to all data. In clinical deployment, however, new organs, institutions, and reporting conventions emerge over time, and sequential fine-tuning can cause catastrophic forgetting. We introduce an exemplar-free continual learning framework for WSI-to-report generation that avoids storing raw slides or patch exemplars. The core idea is a compact domain footprint built in a frozen patch-embedding space: a small codebook of representative morphology tokens together with slide-level co-occurrence summaries and lightweight patch-count priors. These footprints support generative replay by synthesizing pseudo-WSI representations that reflect domain-specific morphological mixtures, while a teacher snapshot provides pseudo-reports to supervise the updated model without retaining past data. To address shifting reporting conventions, we distill domain-specific linguistic characteristics into a compact style descriptor and use it to steer generation. At inference, the model identifies the most compatible descriptor directly from the slide signal, enabling domain-agnostic setup without requiring explicit domain identifiers. Evaluated across multiple public continual learning benchmarks, our approach outperforms exemplar-free and limited-buffer rehearsal baselines, highlighting footprint-based generative replay as a practical solution for deployment in evolving clinical settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。