arXiv:2605.14552cs.CV2026-05

解决真实场景图像分层难题,实现高保真自然图像分割。

LiWi: Layering in the Wild

论文配图:LiWi: Layering in the Wild
图 1 · 摘自论文原文
  • 用智能代理自动构建大规模分层数据集。
  • 在10万张真实图像上实现最高精度的光影与边界建模。
  • 适合需要精细编辑的真实图像应用开发者。

生成模型在图形设计领域的分层图像生成已取得显著进展,但真实场景图像的分层仍面临挑战,限制了细粒度编辑和实际应用。主要瓶颈在于可扩展的分层数据稀缺,以及自然图像中对象间交互(如光照效应、结构边界)的建模不足。为此,我们提出一种高保真自然图像分解新框架。首先,设计基于智能体的数据分解(ADD)流程,通过自动化代理与工具协同,无需人工干预即可合成高质量分层数据;基于此构建了包含超过10万张图像的大规模数据集LiWi-100k。其次,提出联合优化光度保真与透明度边界精度的新方法:阴影引导学习显式建模光照影响,退化-恢复目标通过从退化前景图中恢复干净图像来提供边界修正监督。大量实验表明,该框架在自然图像分解任务中达到当前最优性能,在RGB L1和Alpha IoU指标上优于现有模型。代码与数据集即将开源。

原文摘要 · Abstract (English)

Recent advances in generative models have empowered impressive layered image generation, yet their success is largely confined to graphic design domains. The layering of in-the-wild images remains an underexplored problem, limiting fine-grained editing and applications of images in real-world scenarios. Specifically, challenges remain in scalable layered data and the modeling of object interaction in natural images, such as illumination effects and structural boundary. To address these bottlenecks, we propose a novel framework for high-fidelity natural image decomposition. First, we introduce an Agent-driven Data Decomposition (ADD) pipeline that orchestrates agents and tools to synthesize layered data without manual intervention. Utilizing this pipeline, we construct a large-scale dataset, named LiWi-100k, with over 100,000 high-quality layered in-the-wild images. Second, we present a novel framework that jointly improves photometric fidelity and alpha boundary accuracy. Specifically, shadow-guided learning explicitly models the illumination effects, and degradation-restoration objective provides boundary-correction supervision by recovering clean foreground image from degraded one. Extensive experiments demonstrate that our framework achieves state-of-the-art (SoTA) performance in natural image decomposition, outperforming existing models in RGB L1 and Alpha IoU metrics. We will soon release our code and dataset.

图像分割分层生成真实图像光照建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。