无需微调即可适配新投影场景,实现全场景投影校正。
Setup-Independent Full Projector Compensation
- 分离几何与光照补偿,动态调整投影畸变。
- 在277种不同设置下仍保持高质量校正效果。
- 适合需要快速部署的智能显示、AR应用开发者。
投影校正旨在修复图像投射到非平面或有纹理表面时产生的几何与光度畸变。然而,现有方法高度依赖具体部署环境,一旦表面、光照或投影仪-相机姿态改变,便需重新微调或训练。其发展受限于两大挑战:(1)缺乏大规模、多样化的训练数据集;(2)现有几何校正模型通常受特定空间布局限制,未经再训练难以直接推广至新几何配置。本文提出SIComp,首个无需微调或重训练即可泛化至未见部署场景的完整投影校正框架。为此,我们构建了涵盖277个真实投影-相机配置的大规模数据集。SIComp采用协同自适应设计,将几何与光度分离处理:通过精心设计的光流模块在线完成几何校正,同时引入新型光度网络实现光度补偿。为进一步增强光照变化下的鲁棒性,我们在网络中融入强度可变的表面先验。大量实验表明,SIComp在多种未见配置下均能持续输出高质量校正结果,显著优于现有方法,在泛化能力上建立首个可推广的解决方案。代码与数据集已公开于项目主页:https://hai-bo-li.github.io/SIComp/
原文摘要 · Abstract (English)
Projector compensation seeks to correct geometric and photometric distortions that occur when images are projected onto nonplanar or textured surfaces. However, most existing methods are highly setup-dependent, requiring fine-tuning or retraining whenever the surface, lighting, or projector-camera pose changes. Progress has been limited by two key challenges: (1) the absence of large, diverse training datasets and (2) existing geometric correction models are typically constrained by specific spatial setups; without further retraining or fine-tuning, they often fail to generalize directly to novel geometric configurations. We introduce SIComp, the first Setup-Independent framework for full projector Compensation, capable of generalizing to unseen setups without fine-tuning or retraining. To enable this, we construct a large-scale real-world dataset spanning 277 distinct projector-camera setups. SIComp adopts a co-adaptive design that decouples geometry and photometry: A carefully tailored optical flow module performs online geometric correction, while a novel photometric network handles photometric compensation. To further enhance robustness under varying illumination, we integrate intensity-varying surface priors into the network design. Extensive experiments demonstrate that SIComp consistently produces high-quality compensation across diverse unseen setups, substantially outperforming existing methods in terms of generalization ability and establishing the first generalizable solution to projector compensation. The code and dataset are available on our project page: https://hai-bo-li.github.io/SIComp/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。