用可迁移的低秩卷积基,低成本接入新医学影像模态而不影响已有性能。
Transferable Low-Rank Convolutional Bases for Onboarding Unseen Medical Imaging Modalities

- 用源域学习的低秩卷积基做迁移,仅需0.78%参数即可完成新模态接入。
- 该方法比随机基高6.11个百分点准确率,且不降低原有模态表现。
- 适合需要长期维护多模态模型的医疗AI系统,尤其关注稳定性场景。
在严格留一域外协议下,预训练于肾CT和脑MRI的卷积主干被永久冻结,需接入未见过的胸片模态。结果表明:决策层参数高效微调不足;而基于源域学习的低秩卷积基可有效迁移,仅用0.78%参数即实现比随机基高6.11个百分点的准确率;适配器方式保持源域准确率不变(Δ=0.00百分点),而全微调虽提升目标域性能却严重破坏源域。冻结主干特征的马氏距离能高灵敏度检测未见模态,可作为触发接入的实际依据。所有结果基于三组种子,带配对自举置信区间。
原文摘要 · Abstract (English)
Deploying a medical imaging model that must later accommodate a modality it has never seen is a recurring practical problem: retraining the shared representation is expensive and destroys performance on the modalities already in service. We study this \emph{onboarding} problem under a strict leave-one-domain-out protocol, in which a convolutional backbone is pre-trained on source modalities (Kidney CT and Brain MRI), frozen permanently, and then required to accommodate an unseen modality (Chest X-ray). Under this protocol we establish three findings. First, decision-layer parameter-efficient fine-tuning is insufficient when the backbone has never observed the target modality: a linear probe and fully-connected LoRA both fall well short, whereas convolutional LoRA recovers most of the achievable accuracy, showing that adaptation must reach the convolutional features. Second, and centrally, the low-rank convolutional \emph{basis} learned on the source modalities \emph{transfers}: freezing that basis and training only its up-projections onboards the unseen modality using just $0.78\%$ of full fine-tuning's parameters, at an accuracy $6.11$ percentage points above a random basis of identical size, while an equivalent decision-layer basis exhibits no reliable transfer. Third, adapter-based onboarding leaves source-modality accuracy exactly unchanged ($Δ= 0.00$ pp), whereas full fine-tuning reaches the highest target accuracy only by catastrophically degrading the source modalities. A Mahalanobis score on frozen backbone features detects the unseen modality with high sensitivity at a strict source-retention threshold, providing a practical trigger for when onboarding is required. All results are reported over three seeds with paired bootstrap confidence intervals.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。