arXiv:2503.12173cs.CVcs.MM2025-03被引 5

根据文字指令生成适配表面纹理的投影图像,减少颜色失真。

LAPIG: Language Guided Projector Image Generation with Surface Adaptation and Stylization

  • 通过模拟投影-捕捉过程训练网络,实现快速优化投影图像。
  • 使用内容与饱和度损失约束,生成无明显纹理伪影的图像。
  • 适合需要精准投影风格变换的交互式视觉应用。

我们提出LAPIG,一种基于语言指导的投影图像生成方法,具备表面适应与风格化能力。系统由投影仪-相机装置和目标纹理投影面构成。输入用户文本提示后,目标是通过投影仪改变表面风格。主要挑战在于投影仪物理亮度限制及表面纹理导致观看者感知到明暗区域的颜色过饱和与伪影,即使采用最先进的投影补偿技术,仍可见明显的纹理相关伪影。因此,如何在遵循用户指令的同时最小化表面伪影,仍是开放问题。为此,我们提出投影表面适应(PSA)机制,可生成可补偿的表面风格化图像。首先训练两个网络以模拟投影补偿与投影-捕获流程,使无需真实投影-捕获即可找到满意投影图像,并利用梯度下降实现快速收敛。随后设计内容损失与饱和度损失,引导投影图像生成,确保投影后无明显可察觉伪影。最终生成图像可实现视觉上令人愉悦的表面风格演变效果。代码与视频见项目主页:https://Yu-chen-Deng.github.io/LAPIG/。

原文摘要 · Abstract (English)

We propose LAPIG, a language guided projector image generation method with surface adaptation and stylization. LAPIG consists of a projector-camera system and a target textured projection surface. LAPIG takes the user text prompt as input and aims to transform the surface style using the projector. LAPIG's key challenge is that due to the projector's physical brightness limitation and the surface texture, the viewer's perceived projection may suffer from color saturation and artifacts in both dark and bright regions, such that even with the state-of-the-art projector compensation techniques, the viewer may see clear surface texture-related artifacts. Therefore, how to generate a projector image that follows the user's instruction while also displaying minimum surface artifacts is an open problem. To address this issue, we propose projection surface adaptation (PSA) that can generate compensable surface stylization. We first train two networks to simulate the projector compensation and project-and-capture processes, this allows us to find a satisfactory projector image without real project-and-capture and utilize gradient descent for fast convergence. Then, we design content and saturation losses to guide the projector image generation, such that the generated image shows no clearly perceivable artifacts when projected. Finally, the generated image is projected for visually pleasing surface style morphing effects. The source code and video are available on the project page: https://Yu-chen-Deng.github.io/LAPIG/.

投影生成风格迁移图像优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。