让贴纸贴得更真,还能一键换色实时渲染。
InstantSticker: Realistic Decal Blending via Disentangled Object Reconstruction
- 用分离重建+光照解耦,让贴纸阴影自然真实。
- 贴纸区域变形小、细节清晰,编辑速度大幅提升。
- 适合需要快速生成逼真贴纸的设计师和游戏开发者。
我们提出 InstantSticker,一种基于图像光照(IBL)的解耦重建方法,旨在实现高度真实的贴纸融合效果。通过引入可自适应优化的阴影因子至 IBL,实现了表面阴影与漫反射颜色的精准分离,确保编辑后的纹理具备真实光照响应。为解决先前方法中贴纸区域的扭曲与模糊问题,采用近似刚性(ARAP)参数化预展开网格指定区域,并结合局部UV映射与神经纹理图,显著增强高频细节表达能力。针对即时编辑需求,使用迪士尼BRDF模型显式定义三通道漫反射反照率,支持编辑时直接替换RGB值,避免长时间优化。实验引入比率方差扭曲(RVW)指标评估贴纸区域局部几何扭曲程度。大量实验表明,本方法在编辑质量、速度及渲染效率上均优于现有技术,达到当前最佳水平。
原文摘要 · Abstract (English)
We present InstantSticker, a disentangled reconstruction pipeline based on Image-Based Lighting (IBL), which focuses on highly realistic decal blending, simulates stickers attached to the reconstructed surface, and allows for instant editing and real-time rendering. To achieve stereoscopic impression of the decal, we introduce shadow factor into IBL, which can be adaptively optimized during training. This allows the shadow brightness of surfaces to be accurately decomposed rather than baked into the diffuse color, ensuring that the edited texture exhibits authentic shading. To address the issues of warping and blurriness in previous methods, we apply As-Rigid-As-Possible (ARAP) parameterization to pre-unfold a specified area of the mesh and use the local UV mapping combined with a neural texture map to enhance the ability to express high-frequency details in that area. For instant editing, we utilize the Disney BRDF model, explicitly defining material colors with 3-channel diffuse albedo. This enables instant replacement of albedo RGB values during the editing process, avoiding the prolonged optimization required in previous approaches. In our experiment, we introduce the Ratio Variance Warping (RVW) metric to evaluate the local geometric warping of the decal area. Extensive experimental results demonstrate that our method surpasses previous decal blending methods in terms of editing quality, editing speed and rendering speed, achieving the state-of-the-art.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。