通过跨域特征蒸馏提升目标检测在复杂环境下的鲁棒性
CD-FKD: Cross-Domain Feature Knowledge Distillation for Robust Single-Domain Generalization in Object Detection
- 用降尺度和噪声增强数据训练学生网络,教师用原始数据
- 结合全局与实例级特征蒸馏,提升对难检目标的识别能力
- 适用于自动驾驶、监控等真实场景中的跨域检测任务
单源域泛化对目标检测至关重要,尤其在仅用单一源域训练而需在未见目标域上评估时。天气、光照或场景变化等域偏移严重挑战现有模型的泛化能力。为此,本文提出跨域特征知识蒸馏(CD-FKD),通过全局与实例级特征蒸馏增强学生网络的泛化能力。学生网络采用降尺度和破坏性数据进行训练,教师网络则接收原始源域数据。学生通过模仿教师的特征,有效提取以对象为中心的特征,即使在受干扰情况下也能识别困难目标。大量实验表明,CD-FKD在目标域泛化与源域性能上均优于当前最优方法,验证了其在应对域偏移方面的有效性。该方法对自动驾驶、监控等需要在多样化环境中保持鲁棒检测的应用具有重要价值。
原文摘要 · Abstract (English)
Single-domain generalization is essential for object detection, particularly when training models on a single source domain and evaluating them on unseen target domains. Domain shifts, such as changes in weather, lighting, or scene conditions, pose significant challenges to the generalization ability of existing models. To address this, we propose Cross-Domain Feature Knowledge Distillation (CD-FKD), which enhances the generalization capability of the student network by leveraging both global and instance-wise feature distillation. The proposed method uses diversified data through downscaling and corruption to train the student network, whereas the teacher network receives the original source domain data. The student network mimics the features of the teacher through both global and instance-wise distillation, enabling it to extract object-centric features effectively, even for objects that are difficult to detect owing to corruption. Extensive experiments on challenging scenes demonstrate that CD-FKD outperforms state-of-the-art methods in both target domain generalization and source domain performance, validating its effectiveness in improving object detection robustness to domain shifts. This approach is valuable in real-world applications, like autonomous driving and surveillance, where robust object detection in diverse environments is crucial.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。