通过视觉提示自适应更新云端模型,提升动态交通场景下的伪标签质量。
High-Quality Pseudo-Label Generation Based on Visual Prompt Assisted Cloud Model Update
- 引入可学习的视觉提示生成器,实现参数高效适配。
- 结合全局与细粒度特征对齐,有效缓解分布偏移问题。
- 适合实时变化场景下的云边协同目标检测系统使用。
在动态交通监控中,云端高质量伪标签生成对云边目标检测至关重要,但现有方法常假设云端模型可靠,忽视错误传播或复杂分布漂移。本文提出云自适应高质量伪标签生成方法(CA-HQP),通过可学习的视觉提示生成器(VPG)和双重特征对齐机制更新云端模型。VPG通过注入视觉提示实现参数高效适配,避免大规模微调。CA-HQP采用两种对齐策略:全局场景级域查询特征对齐(DQFA)捕捉整体分布变化,细粒度时序实例感知特征嵌入对齐(TIAFA)应对实例级差异。在Bellevue交通数据集上的实验表明,相比现有方法,CA-HQP显著提升了伪标签质量,边缘模型性能明显增强,验证了其自适应更新的有效性。消融实验证实DQFA、TIAFA和VPG各组件及其协同作用的重要性,强调了自适应云端更新与领域自适应对持续演进场景下鲁棒目标检测的关键作用。
原文摘要 · Abstract (English)
Generating high-quality pseudo-labels on the cloud is crucial for cloud-edge object detection, especially in dynamic traffic monitoring where data distributions evolve. Existing methods often assume reliable cloud models, neglecting potential errors or struggling with complex distribution shifts. This paper proposes Cloud-Adaptive High-Quality Pseudo-label generation (CA-HQP), addressing these limitations by incorporating a learnable Visual Prompt Generator (VPG) and dual feature alignment into cloud model updates. The VPG enables parameter-efficient adaptation by injecting visual prompts, enhancing flexibility without extensive fine-tuning. CA-HQP mitigates domain discrepancies via two feature alignment techniques: global Domain Query Feature Alignment (DQFA) capturing scene-level shifts, and fine-grained Temporal Instance-Aware Feature Embedding Alignment (TIAFA) addressing instance variations. Experiments on the Bellevue traffic dataset demonstrate that CA-HQP significantly improves pseudo-label quality compared to existing methods, leading to notable performance gains for the edge model and showcasing CA-HQP's adaptation effectiveness. Ablation studies validate each component (DQFA, TIAFA, VPG) and the synergistic effect of combined alignment strategies, highlighting the importance of adaptive cloud updates and domain adaptation for robust object detection in evolving scenarios. CA-HQP provides a promising solution for enhancing cloud-edge object detection systems in real-world applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。