arXiv:2505.18315cs.CVcs.AI2025-05被引 1

CoLoRA让卷积模型微调更高效,参数减少超80%且不增加推理负担。

COLORA: Efficient Fine-Tuning for Convolutional Models with a Study Case on Optical Coherence Tomography Image Classification

  • 将卷积核更新分解为轻量深度与点卷积,降低参数量
  • 在OCTMNISTv2上达竞品性能,参数量减少超80%
  • 适合医疗图像等资源受限场景的高效微调

我们提出CoLoRA(卷积低秩适配),一种针对卷积神经网络(CNN)的参数高效微调方法。CoLoRA通过将卷积核更新分解为轻量级深度卷积和点卷积组件,扩展了LoRA至卷积层。该设计使可训练卷积更新参数数量相比全卷积微调减少超过80%,同时允许学习到的更新合并进预训练卷积核中,保持原始模型大小与推理复杂度不变。在MedMNIST数据集,特别是OCTMNISTv2上的实验表明,CoLoRA应用于VGG16和ResNet50时,在显著减少可训练参数的同时,仍能实现具有竞争力的分类性能。与迁移学习、适配器、BitFit及卷积LoRA变体的对比进一步刻画了预测性能、可训练参数量与训练成本之间的权衡。在CIFAR-100和猫狗分类任务上的初步实验显示,该适配策略也适用于非医疗图像分类任务。峰值GPU内存测量结果表明,参数效率并不直接转化为成比例的训练内存节省,内存消耗强烈依赖于被适配卷积层的位置。总体而言,CoLoRA为卷积模型提供了参数高效且部署高效的全微调替代方案。

原文摘要 · Abstract (English)

We introduce CoLoRA (Convolutional Low-Rank Adaptation), a parameter-efficient fine-tuning method for convolutional neural networks (CNNs). CoLoRA extends LoRA to convolutional layers by decomposing kernel updates into lightweight depthwise and pointwise components. This design reduces the number of trainable convolutional-update parameters by over 80\% compared with full convolutional fine-tuning, while allowing the learned updates to be merged into the pretrained convolutional kernels, thereby preserving the original model size and inference complexity. Experiments on MedMNIST datasets, particularly OCTMNISTv2, demonstrate that CoLoRA applied to VGG16 and ResNet50 achieves competitive classification performance while substantially reducing the number of trainable parameters. Comparisons with transfer learning, adapters, BitFit, and convolutional LoRA variants further characterize the trade-offs among predictive performance, trainable parameters, and training cost. Additional experiments on CIFAR-100 and Cats vs. Dogs provide preliminary evidence that the proposed adaptation strategy also transfers to non-medical image-classification tasks. Peak GPU-memory measurements further show that parameter efficiency does not translate directly into proportional training-memory savings, with memory consumption depending strongly on the placement of the adapted convolutional layers. Overall, CoLoRA provides a parameter-efficient and deployment-efficient alternative to full fine-tuning for convolutional models.

卷积微调低秩适配医疗图像参数效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。