用文字锚点保持视觉关系,让模型持续学习不遗忘。
Language as an Anchor: Preserving Relative Visual Geometry for Domain Incremental Learning
- 用文本语义对齐视觉特征,保持类间相对关系
- 在多个基准上超越现有方法,显著减少遗忘
- 适合需要长期学习的场景,如持续视觉识别
领域增量学习(DIL)的核心挑战是在分布变化下持续学习,同时保留以往知识。现有方法面临两难:将所有领域映射到统一视觉空间会导致域间干扰和语义扭曲;而隔离域特定参数则造成知识碎片化,形成‘知识孤岛’,阻碍知识复用并加剧遗忘。为此,我们提出LAVA(语言锚定视觉对齐)框架,以文本为参考锚点,替代直接特征对齐,引导新领域视觉表征保持一致的相对几何结构。该结构通过镜像类别名称间的语义相似性定义,作为跨域桥梁,支持类别感知先验知识的检索与鲁棒特征聚合。在标准DIL基准上的大量实验表明,LAVA显著优于现有最优方法。代码已开源。
原文摘要 · Abstract (English)
A key challenge in Domain Incremental Learning (DIL) is to continually learn under shifting distributions while preserving knowledge from previous domains. Existing methods face a fundamental dilemma. On one hand, projecting all domains into a single unified visual space leads to inter-domain interference and semantic distortion, as large shifts may vary with not only visual appearance but also underlying semantics. On the other hand, isolating domain-specific parameters causes knowledge fragmentation, creating "knowledge islands" that hamper knowledge reuse and exacerbate forgetting. To address this issue, we propose LAVA (Language-Anchored Visual Alignment), a novel DIL framework that replaces direct feature alignment with relative alignment driven by a text-based reference anchor. LAVA guides the visual representations of each incoming domain to preserve a consistent relative geometry, which is defined by mirroring the pairwise semantic similarities between the class names. This anchored geometric structure acts as a bridge across domains, enabling the retrieval of class-aware prior knowledge and facilitating robust feature aggregation. Extensive experiments on standard DIL benchmarks demonstrate that LAVA achieves significant performance improvements over state-of-the-arts. Code is available at https://github.com/ShuyiGeng/LAVA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。