用对数共形映射简化视角畸变建模,提升视觉表征鲁棒性。
LCM: Log Conformal Maps for Robust Representation Learning to Mitigate Perspective Distortion
- 基于对数函数设计少参数映射,降低视角畸变建模复杂度
- 在Imagenet-PD/Imagene-E/X上超越标准模型,接近顶尖性能
- 适配监督与自监督学习,可直接用于行人重识别等任务
视角畸变会显著改变图像中视觉元素的形状、大小、方向、角度和空间关系。准确确定相机内参与外参困难,难以有效合成视角畸变。现有校正方法需先去畸变再学习视觉任务,为多步流程且常影响性能。近期工作采用莫比乌斯变换(MPD)在不估计相机参数下合成畸变,但该方法需调节多个相互关联的参数,计算复杂度高。为此,本文提出对数共形映射(LCM),利用对数函数以更少参数近似视角畸变,显著降低计算开销。我们通过详尽的理论分析与实验验证表明,LCM以少量参数即可逼近MPD效果。同时,LCM能良好融入监督与自监督表示学习,在Imagenet-PD、Imagenet-E、Imagenet-X等多个基准上表现优于标准模型,达到当前最优水平。进一步实验显示,其可无缝集成于行人重识别任务并提升性能。代码已开源:https://github.com/meenakshi23/Log-Conformal-Maps。
原文摘要 · Abstract (English)
Perspective distortion (PD) leads to substantial alterations in the shape, size, orientation, angles, and spatial relationships of visual elements in images. Accurately determining camera intrinsic and extrinsic parameters is challenging, making it hard to synthesize perspective distortion effectively. The current distortion correction methods involve removing distortion and learning vision tasks, thus making it a multi-step process, often compromising performance. Recent work leverages the Möbius transform for mitigating perspective distortions (MPD) to synthesize perspective distortions without estimating camera parameters. Möbius transform requires tuning multiple interdependent and interrelated parameters and involving complex arithmetic operations, leading to substantial computational complexity. To address these challenges, we propose Log Conformal Maps (LCM), a method leveraging the logarithmic function to approximate perspective distortions with fewer parameters and reduced computational complexity. We provide a detailed foundation complemented with experiments to demonstrate that LCM with fewer parameters approximates the MPD. We show that LCM integrates well with supervised and self-supervised representation learning, outperform standard models, and matches the state-of-the-art performance in mitigating perspective distortion over multiple benchmarks, namely Imagenet-PD, Imagenet-E, and Imagenet-X. Further LCM demonstrate seamless integration with person re-identification and improved the performance. Source code is made publicly available at https://github.com/meenakshi23/Log-Conformal-Maps.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。