用知识锚点提升低资源场景下的哈希检索效果。
KALAHash: Knowledge-Anchored Low-Resource Adaptation for Deep Hashing
- 引入类级文本嵌入构建动态低秩适配矩阵,实现参数高效微调。
- 在仅需4倍少数据条件下,检索性能显著优于现有方法。
- 适合小样本哈希任务,尤其对数据稀缺场景有实用价值。
深度哈希因存储与搜索效率高,被广泛用于大规模近似最近邻搜索。然而,现有方法大多依赖大量训练数据,对低资源适配这一更具挑战性的场景关注不足——即仅用极少样本将预训练模型适配至下游任务。初步基准测试显示,由于训练样本有限导致的分布偏移,现有方法性能严重下降。为此,我们提出类校准LoRA(CLoRA),一种即插即用的方法,通过利用类级文本知识嵌入动态构建低秩适配矩阵,将先验类别知识作为锚点,实现参数高效微调并保持原始数据分布。此外,我们设计知识引导离散优化框架(KIDDO),利用类别知识弥补视觉信息不足,增强哈希码的判别能力。大量实验表明,所提方法(KALAHash)在低资源场景下显著提升检索性能,在仅需4倍少数据时仍表现优异。
原文摘要 · Abstract (English)
Deep hashing has been widely used for large-scale approximate nearest neighbor search due to its storage and search efficiency. However, existing deep hashing methods predominantly rely on abundant training data, leaving the more challenging scenario of low-resource adaptation for deep hashing relatively underexplored. This setting involves adapting pre-trained models to downstream tasks with only an extremely small number of training samples available. Our preliminary benchmarks reveal that current methods suffer significant performance degradation due to the distribution shift caused by limited training samples. To address these challenges, we introduce Class-Calibration LoRA (CLoRA), a novel plug-and-play approach that dynamically constructs low-rank adaptation matrices by leveraging class-level textual knowledge embeddings. CLoRA effectively incorporates prior class knowledge as anchors, enabling parameter-efficient fine-tuning while maintaining the original data distribution. Furthermore, we propose Knowledge-Guided Discrete Optimization (KIDDO), a framework to utilize class knowledge to compensate for the scarcity of visual information and enhance the discriminability of hash codes. Extensive experiments demonstrate that our proposed method, Knowledge- Anchored Low-Resource Adaptation Hashing (KALAHash), significantly boosts retrieval performance and achieves a 4x data efficiency in low-resource scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。