调整病理图像输入设计,可让通用大模型性能提升近3倍
How Seemingly Inconsequential Design Choices Dictate Performance of LLMs in Pathology

- 用大尺度低倍率图像块联合处理,取代小块独立投票
- 癌症分类准确率从15.1%升至39.5%,器官分类从38.1%升至62.9%
- 方法简单通用,适用于多模型和未见数据集
通用大语言模型(LLM)常被用作病理全切片图像(WSI)任务的基线。由于WSI超出当前模型上下文限制,现有方法通常采用小尺寸高倍率图像块独立处理并进行多数投票,但未系统评估诸如图像块大小、数量和放大倍数等看似无关的设计选择。通用模型表现持续低于专业系统,强化了领域特定训练或架构改造的必要性。本文对四个输入设计因素(推理模式、图像块大小、放大倍数、图像块数量)进行系统性因子分析。结果表明,先前研究夸大了专用模型与通用模型之间的差距,因使用了非优化的输入配置。在MultiPathQA基准上,采用单一均衡配置(大图像块、低倍率、联合处理),GPT-5在癌症类型分类(TCGA)上从15.1%提升至39.5%,在器官分类(GTEx)上从38.1%提升至62.9%。每任务优化后进一步提升至43.9%(TCGA)和71.6%(GTEx)。该配置同样适用于其他两个模型及完全保留的CPTAC队列,在未进行任务微调的情况下使Gemini 3 Flash提升23.4个百分点。
原文摘要 · Abstract (English)
General-purpose large language models (LLMs) are routinely used as baselines when evaluating specialized pathology models on whole-slide images (WSIs). Because WSIs exceed contemporary model context limits, LLM baselines routinely use small, high-magnification patches processed independently via majority voting, without systematic evaluation of seemingly inconsequential design choices such as patch size, patch count, and magnification. Generalist LLMs have consistently underperformed specialized systems, reinforcing the perception that domain-specific training or architectural adaptation is necessary for pathology tasks involving WSIs. Here, we conduct a systematic factorial analysis of four input design factors: inference mode, patch size, magnification, and patch count. We demonstrate that prior studies have overstated the gap between specialized models and general-purpose LLMs by choosing non-optimized input configurations. On the MultiPathQA benchmark, switching to a single balanced configuration (large patches at lower magnification, processed jointly) raises GPT-5 from 15.1% to 39.5% on cancer-type classification (TCGA) and from 38.1% to 62.9% on organ classification (GTEx). Per-task optimization yields further gains up to 43.9% (TCGA) and 71.6% (GTEx). The same configuration generalizes to two other models and to a fully held-out CPTAC cohort, where it improves Gemini 3 Flash by 23.4 percentage points without any task-specific tuning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。