arXiv:2607.29462eess.IVcs.CV2026-07中稿 · EMA4MICCAI 2026

用稀疏路由专家模型,让一个医学图像分类器同时处理多种病种数据。

MoPET: Parameter-Efficient Mixture-of-Experts for Unified Medical Image Classification

论文配图:MoPET: Parameter-Efficient Mixture-of-Experts for Unified Medical Image Classification
图 1 · 摘自论文原文
  • 通过低秩适配器和稀疏路由,只激活部分专家处理输入。
  • 统一模型在4个数据集上平均准确率达93.46%,优于单独适配器的92.83%。
  • 利用辅助数据联合训练,提升小样本临床任务准确率至83.58%。

将深度学习模型适配于复杂的临床异质性通常依赖参数高效微调(PEFT)以避免全网络更新带来的严重过拟合。尽管PEFT在数据有限场景下表现良好,但需为每个诊断任务独立训练隔离的适配器。将这些适配器整合到单一通用网络会引发负迁移,因来自不同视觉域的优化梯度相互干扰。为此,我们提出MoPET,一种基于混合专家(MoE)的方法,使用可学习的稀疏路由器将每个输入导向少量注入冻结基础模型的低秩PEFT专家,实现跨数据集容量共享并减少跨域梯度冲突。在MedMNIST基准上的评估显示,PEFT将平均准确率从86.50%提升至88.97%;单个MoPET模型整合四个异构数据集,平均准确率达93.46%,超过最佳孤立适配器的92.83%;此外,通过辅助数据联合训练,目标数据集的平均准确率从81.58%提升至83.58%。源代码已公开。

原文摘要 · Abstract (English)

Adapting deep learning models to profound clinical heterogeneity typically relies on parameter-efficient fine-tuning (PEFT) to avoid the severe overfitting associated with full end-to-end network updates. Although PEFT successfully navigates limited data scenarios, it inherently forces the training of a separate, isolated adapter for every specific diagnostic task. Consolidating these isolated adapters into a single generalist network risks negative transfer, as optimization gradients from conflicting visual domains interfere. To address this, we propose MoPET, a mixture-of-experts (MoE) method that uses a learned sparse router to direct each input through a small subset of low-rank PEFT experts injected into a frozen foundation model, sharing capacity across datasets while limiting cross-domain gradient conflict. Through selected evaluations on the MedMNIST benchmark, we first establish that PEFT outperforms full network updates, improving average accuracy from 86.50% to 88.97%. We then show that a single MoPET model consolidates four heterogeneous datasets into one network, improving average accuracy over the best isolated PEFT adapters (93.46% versus 92.83%). Finally, we show that co-training with auxiliary datasets improves accuracy on data-constrained clinical targets, raising average target accuracy over the strongest isolated adapter from 81.58% to 83.58%. Our source code is publicly available at https://github.com/sdoerrich97/mopet.

医学图像专家混合参数高效多任务学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。