arXiv:2507.20745cs.CVcs.AI2025-07中稿 · ACMMM2025

提出ReSoRA,解决LoRA适配中子空间冗余问题,提升模型表现。

Regularizing Subspace Redundancy of Low-Rank Adaptation

  • 通过分解低秩子矩阵,显式建模子空间冗余并施加去冗余约束。
  • 在视觉-语言检索与图像分类任务中,显著提升现有PETL方法性能。
  • 可无缝集成,无需额外推理开销,适合各类骨干网络和数据集。

低秩适配(LoRA)及其变体通过减少可训练参数并利用重参数化,在参数高效迁移学习(PETL)中表现出强大能力。然而,其投影矩阵在训练过程中未受约束,导致高表示冗余,削弱了特征适配效果。现有方法通过手动调整秩或隐式应用通道掩码缓解此问题,但灵活性差且泛化能力弱。为此,我们提出ReSoRA,一种显式建模映射子空间冗余并自适应正则化低秩适配子空间冗余的方法。具体而言,理论分解低秩子矩阵为多个等效子空间,并系统地对不同投影间的特征分布施加去冗余约束。大量实验验证,所提方法在多种骨干网络和数据集上的视觉-语言检索与标准图像分类基准中,持续提升现有顶尖PETL方法的性能。此外,作为训练监督,ReSoRA可无痛集成至现有方法,无额外推理成本。代码已公开于:https://github.com/Lucenova/ReSoRA。

原文摘要 · Abstract (English)

Low-Rank Adaptation (LoRA) and its variants have delivered strong capability in Parameter-Efficient Transfer Learning (PETL) by minimizing trainable parameters and benefiting from reparameterization. However, their projection matrices remain unrestricted during training, causing high representation redundancy and diminishing the effectiveness of feature adaptation in the resulting subspaces. While existing methods mitigate this by manually adjusting the rank or implicitly applying channel-wise masks, they lack flexibility and generalize poorly across various datasets and architectures. Hence, we propose ReSoRA, a method that explicitly models redundancy between mapping subspaces and adaptively Regularizes Subspace redundancy of Low-Rank Adaptation. Specifically, it theoretically decomposes the low-rank submatrices into multiple equivalent subspaces and systematically applies de-redundancy constraints to the feature distributions across different projections. Extensive experiments validate that our proposed method consistently facilitates existing state-of-the-art PETL methods across various backbones and datasets in vision-language retrieval and standard visual classification benchmarks. Besides, as a training supervision, ReSoRA can be seamlessly integrated into existing approaches in a plug-and-play manner, with no additional inference costs. Code is publicly available at: https://github.com/Lucenova/ReSoRA.

LoRA参数效率子空间正则

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。