通过抑制特定领域信息提升自动驾驶图像分割的泛化能力
Domain Generalization through Attenuation of Domain-Specific Information
- 用迪氏独立性指标定位图像中领域特有信息分布
- 采用巴特沃斯滤波器保留低频关键特征,仅削弱领域专属成分
- 在合成与真实场景间迁移表现优于传统方法,适合跨环境视觉任务
本文提出一种新的评估指标——领域独立性(DI)与领域特异性信息衰减(ADSI),专门用于汽车图像的领域泛化语义分割。DI衡量领域特有信息的存在程度:值越低表示领域依赖越强,值越高则表明领域独立性越强,可定位领域特有信息的分布区域及频率范围。基于此,可针对性抑制含领域特有信息的图像区域,实现与领域无关的特征提取。ADSI利用巴特沃斯滤波器去除包含传感器特性、光照条件等固有领域信息的低频分量,但因低频也承载颜色等关键信息,故引入0至1间的缩放系数,部分保留低频内容,以帮助模型学习更领域无关的特征。实验中,以GTA5(合成数据集)为训练集,真实数据集为测试集,该方法显著优于传统方法;当以Cityscapes(真实数据集)为训练集,夜间、雨天等多环境数据集为测试集时,其在夜间条件下仍保持鲁棒性。
原文摘要 · Abstract (English)
In this paper, we propose a new evaluation metric called Domain Independence (DI) and Attenuation of Domain-Specific Information (ADSI) which is specifically designed for domain-generalized semantic segmentation in automotive images. DI measures the presence of domain-specific information: a lower DI value indicates strong domain dependence, while a higher DI value suggests greater domain independence. This makes it roughly where domain-specific information exists and up to which frequency range it is present. As a result, it becomes possible to effectively suppress only the regions in the image that contain domain-specific information, enabling feature extraction independent of the domain. ADSI uses a Butterworth filter to remove the low-frequency components of images that contain inherent domain-specific information such as sensor characteristics and lighting conditions. However, since low-frequency components also contain important information such as color, we should not remove them completely. Thus, a scalar value (ranging from 0 to 1) is multiplied by the low-frequency components to retain essential information. This helps the model learn more domain-independent features. In experiments, GTA5 (synthetic dataset) was used as training images, and a real-world dataset was used for evaluation, and the proposed method outperformed conventional approaches. Similarly, in experiments that the Cityscapes (real-world dataset) was used for training and various environment datasets such as rain and nighttime were used for evaluation, the proposed method demonstrated its robustness under nighttime conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。