提出可调控鱼眼图像畸变校正方法,无需重训练即可适应不同畸变程度。
QueryCDR: Query-Based Controllable Distortion Rectification Network for Fisheye Images
- 用可学习查询机制建模不同畸变程度的隐空间关系。
- 通过可控调制模块实现对畸变特征的精准调节。
- 在多种畸变数据集上表现优异,适合实际应用中的动态场景。
鱼眼图像校正旨在修复鱼眼相机拍摄图像中的畸变。尽管现有模型在与训练数据畸变程度相似的图像上表现良好,但当畸变程度变化时,若不重新训练,其效果会显著下降。这种对不同畸变程度缺乏泛化能力,限制了实际应用。本文提出一种新型基于查询的可调控鱼眼图像畸变校正网络(QueryCDR)。我们首先设计畸变感知可学习查询机制(DLQM),将不同畸变程度的潜在空间关系表示为一系列可学习查询,每个查询可学习得到依赖位置的校正控制条件,从而实现对校正过程的控制。随后,提出两种可控调制块,使控制条件能更有效地引导畸变特征的调制。这些核心组件协同工作,显著提升了模型在不同畸变程度下的泛化能力。在多个具有不同畸变程度的鱼眼图像数据集上的大量实验表明,该方法实现了高质量且可控的畸变校正。
原文摘要 · Abstract (English)
Fisheye image rectification aims to correct distortions in images taken with fisheye cameras. Although current models show promising results on images with a similar degree of distortion as the training data, they will produce sub-optimal results when the degree of distortion changes and without retraining. The lack of generalization ability for dealing with varying degrees of distortion limits their practical application. In this paper, we take one step further to enable effective distortion rectification for images with varying degrees of distortion without retraining. We propose a novel Query-Based Controllable Distortion Rectification network for fisheye images (QueryCDR). In particular, we first present the Distortion-aware Learnable Query Mechanism (DLQM), which defines the latent spatial relationships for different distortion degrees as a series of learnable queries. Each query can be learned to obtain position-dependent rectification control conditions, providing control over the rectification process. Then, we propose two kinds of controllable modulating blocks to enable the control conditions to guide the modulation of the distortion features better. These core components cooperate with each other to effectively boost the generalization ability of the model at varying degrees of distortion. Extensive experiments on fisheye image datasets with different distortion degrees demonstrate our approach achieves high-quality and controllable distortion rectification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。