arXiv:2506.24063cs.CV2025-06ICCV被引 3

通过环境条件生成参数,实现动态场景下目标检测的持续适应

Continual Adaptation: Environment-Conditional Parameter Generation for Object Detection in Dynamic Scenarios

  • 用双路径LoRA解耦特征,分离领域不变与特定成分
  • 基于扩散模型生成适配器参数,避免优化陷入局部最优
  • 采用类别中心最优传输缓解灾难性遗忘,适合实时部署

现实中环境随时间和空间持续变化,而基于封闭集假设训练的目标检测器难以应对。为此,本文提出一种持续测试时自适应方法,将微调过程转化为特定参数生成。设计了基于LoRA的双路径域感知适配器,分离出领域不变与领域特定特征,实现高效适应。进一步提出基于条件扩散的参数生成机制,根据当前环境合成适配器参数,防止优化陷入局部极小。最后引入类别中心最优传输对齐方法,缓解灾难性遗忘。在多个连续域适应目标检测任务上实验验证了有效性。可视化结果表明,生成参数提取的表征能捕捉更多物体相关信息,增强泛化能力。

原文摘要 · Abstract (English)

In practice, environments constantly change over time and space, posing significant challenges for object detectors trained based on a closed-set assumption, i.e., training and test data share the same distribution. To this end, continual test-time adaptation has attracted much attention, aiming to improve detectors' generalization by fine-tuning a few specific parameters, e.g., BatchNorm layers. However, based on a small number of test images, fine-tuning certain parameters may affect the representation ability of other fixed parameters, leading to performance degradation. Instead, we explore a new mechanism, i.e., converting the fine-tuning process to a specific-parameter generation. Particularly, we first design a dual-path LoRA-based domain-aware adapter that disentangles features into domain-invariant and domain-specific components, enabling efficient adaptation. Additionally, a conditional diffusion-based parameter generation mechanism is presented to synthesize the adapter's parameters based on the current environment, preventing the optimization from getting stuck in local optima. Finally, we propose a class-centered optimal transport alignment method to mitigate catastrophic forgetting. Extensive experiments conducted on various continuous domain adaptive object detection tasks demonstrate the effectiveness. Meanwhile, visualization results show that the representation extracted by the generated parameters can capture more object-related information and strengthen the generalization ability.

目标检测持续学习参数生成扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。