arXiv:2512.05359cs.CV2025-12AAAI被引 2

通过分组正交约束,让低秩适配更高效地学习多样特征。

Group Orthogonal Low-Rank Adaptation for RGB-T Tracking

  • 用奇异值分解量化秩重要性,分组冻结关键秩
  • 引入组间正交约束,减少冗余并提升表征能力
  • 在4个数据集上超越现有方法,适合高效追踪任务

参数高效微调已成为RGB-T追踪的主流范式,通过冻结预训练参数仅微调少量参数实现下游任务适配。这些参数构成一个由多个独立秩组成的秩空间,其表达能力直接影响模型适应性。然而定量分析发现,低秩适配在秩空间中存在显著冗余,许多秩几乎不提供实际信息,阻碍模型学习多样化知识以应对复杂挑战。为此,我们提出用于RGB-T追踪的分组正交低秩适配(GOLA)框架,通过结构化参数学习有效利用秩空间。具体地,采用奇异值分解进行秩分解划分,量化秩的重要性,冻结关键秩以保留预训练先验,并将冗余秩聚类分组,为后续正交约束做准备。进一步设计组间正交约束策略,强制不同秩组学习互补特征,从而缓解信息冗余。实验结果表明,GOLA有效降低参数冗余,增强特征表示能力,在四个基准数据集上显著优于现有最先进方法,验证了其在RGB-T追踪任务中的有效性。

原文摘要 · Abstract (English)

Parameter-efficient fine-tuning has emerged as a promising paradigm in RGB-T tracking, enabling downstream task adaptation by freezing pretrained parameters and fine-tuning only a small set of parameters. This set forms a rank space made up of multiple individual ranks, whose expressiveness directly shapes the model's adaptability. However, quantitative analysis reveals low-rank adaptation exhibits significant redundancy in the rank space, with many ranks contributing almost no practical information. This hinders the model's ability to learn more diverse knowledge to address the various challenges in RGB-T tracking. To address this issue, we propose the Group Orthogonal Low-Rank Adaptation (GOLA) framework for RGB-T tracking, which effectively leverages the rank space through structured parameter learning. Specifically, we adopt a rank decomposition partitioning strategy utilizing singular value decomposition to quantify rank importance, freeze crucial ranks to preserve the pretrained priors, and cluster the redundant ranks into groups to prepare for subsequent orthogonal constraints. We further design an inter-group orthogonal constraint strategy. This constraint enforces orthogonality between rank groups, compelling them to learn complementary features that target diverse challenges, thereby alleviating information redundancy. Experimental results demonstrate that GOLA effectively reduces parameter redundancy and enhances feature representation capabilities, significantly outperforming state-of-the-art methods across four benchmark datasets and validating its effectiveness in RGB-T tracking tasks.

RGB-T追踪低秩适配正交约束

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。