通过改进预训练与增强策略,提升零样本跨城市目标检测性能。
Rethinking Pre-Training and Augmentation for Zero-Shot Cross-City Object Detection

- 采用多数据集预训练+无类别感知的几何解耦方法,分离车辆结构与语义信息。
- 引入灰度世界增强,强制模型依赖形状先验而非颜色特征,提升鲁棒性。
- 在16GB显存下实现跨城市检测领先性能,适合隐私敏感场景应用。
真实交通监控系统部署受地理域偏移限制,即在某城市训练的模型在未见目标城市表现下降。传统域适应依赖超参数敏感架构或目标数据直接采样,在注重隐私的环境中不可行。本文探索预训练与增强对域偏移问题的影响,提出一种模块化训练流程:(1) 多数据集预训练策略,通过类无关物体存在性蒸馏,将车辆几何结构与语义分类解耦;(2) 域鲁棒增强流,引入新颖的灰度世界变换,迫使全局注意力头摒弃易变的颜色捷径,转而依赖稳健的形状先验。在实时基于Transformer的检测器RF-DETR上评估,本框架在仅16GB GPU内存条件下弥合跨城市分布差距。优化版本RF-DETR-HR与RF-DETR-Grayworld相比基线提升24.29,以47.53 mAP夺得AI City Challenge Track 6第一名。代码与数据已公开于:https://github.com/SKKUAutoLab/aic26_cross_city。
原文摘要 · Abstract (English)
Real-world deployment of traffic surveillance systems is bottlenecked by geographic domain shift, in which models trained in one city underperform when applied to an unseen target city. Conventional domain adaptation relies on hyperparameter-sensitive architectures or direct profiling of target data. Both are fundamentally precluded in privacy-conscious ecosystems that require completely blind training and evaluation loops. In this setting, we explore the effects of pre-training and augmentation in addressing the domain shift problem. Specifically, we propose a new modular training pipeline for object detection structured around two core orthogonal pillars: (1) a multi-dataset pre-training strategy featuring a class-agnostic objectness distillation to decouple structural vehicle geometry from semantic taxonomies, and (2) a domain-resilient augmentation stream featuring a novel Grayworld transformation that forces global attention heads to strip volatile chromatic shortcuts in favor of robust shape priors. When evaluated with the real-time transformer-based detector RF-DETR, our framework bridges cross-city distribution gaps while using limited GPU memory (16GB). Our optimized variants, RF-DETR-HR and RF-DETR-Grayworld, deliver a substantial empirical gain of +24.29 over the baseline, achieving 1st place (47.53 mAP) on the AI City Challenge Track 6 leaderboard. Code and data are available at: \href{https://github.com/SKKUAutoLab/aic26_cross_city}{SKKUAutoLab/aic26\_cross\_city}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。