用圆环覆盖解决颜色变换中的失真问题,提升模型鲁棒性。
A Hypertoroidal Covering for Perfect Color Equivariance
- 将颜色区间值映射到双覆盖圆环,实现真正等变
- 在细粒度分类与医学图像任务中性能超越基线
- 方法可推广至尺度等几何变换,通用性强
当输入图像的颜色分布发生变化时,传统神经网络性能显著下降。已有研究尝试在神经网络设计中引入颜色几何先验,通过二维旋转建模色相变化,一维平移建模饱和度与亮度变化。然而,将区间值近似为实数轴会引入明显误差。本文提出一种真正的颜色等变架构:将区间上的值提升到圆环(双覆盖)上构建等变表示。该方法消除了原有近似带来的伪影,提升了可解释性与泛化能力,在细粒度分类和医学图像任务中均优于传统及等变基线。此外,所提提升机制还可拓展至尺度等几何变换。
原文摘要 · Abstract (English)
When the color distribution of input images changes at inference, the performance of conventional neural network architectures drops considerably. A few researchers have begun to incorporate prior knowledge of color geometry in neural network design. These color equivariant architectures have modeled hue variation with 2D rotations, and saturation and luminance transformations as 1D translations. While this approach improves neural network robustness to color variations in a number of contexts, we find that approximating saturation and luminance (interval valued quantities) as 1D translations introduces appreciable artifacts. In this paper, we introduce a color equivariant architecture that is truly equivariant. Instead of approximating the interval with the real line, we lift values on the interval to values on the circle (a double-cover) and build equivariant representations there. Our approach resolves the approximation artifacts of previous methods, improves interpretability and generalizability, and achieves better predictive performance than conventional and equivariant baselines on tasks such as fine-grained classification and medical imaging tasks. Going beyond the context of color, we show that our proposed lifting can also extend to geometric transformations such as scale.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。