用隐空间解耦曝光与场景生成,单次完成全景HDR图像合成。
LatentHDR: Decoupling Exposure from Diffusion via Conditional Latent-to-Latent Mapping for Text/Image-to-Panoramic HDR

- 在隐空间中将场景与曝光分离建模,通过条件映射生成多曝光图像。
- 单次推理完成高动态范围合成,计算量降低十倍,结构一致性更强。
- 支持文本与图像输入,适用于全景与透视场景,性能领先现有方法。
高动态范围(HDR)生成对生成模型仍具挑战性,因多数模型仅限于低动态范围输出。近期基于扩散的方法通过生成多个曝光条件样本近似HDR,但带来高昂计算开销和跨曝光结构不一致问题。本文提出LatentHDR,一种在隐空间中解耦场景生成与曝光建模的框架。预训练扩散主干生成单一连贯场景表示,轻量级条件隐空间到隐空间头则确定性地将其映射为特定曝光的表示。该设计实现单次推理下密集、结构一致的曝光堆栈生成,消除多步扩散过程,确保跨曝光对齐,支持可扩展的HDR合成。LatentHDR支持文本与图像条件的全景及透视场景HDR生成。在合成数据与SI-HDR基准上的实验表明,其达到当前最优动态范围,感知质量优异,同时计算成本降低一个数量级。结果表明,通过结构化隐空间建模即可实现高质量HDR生成,挑战了传统随机多曝光生成的必要性。
原文摘要 · Abstract (English)
High Dynamic Range (HDR) generation remains challenging for generative models, which are largely limited to low dynamic range outputs. Recent diffusionbased approaches approximate HDR by generating multiple exposure-conditioned samples, incurring high computational cost and structural inconsistencies across exposures. We propose LatentHDR, a framework that decouples scene generation from exposure modeling in latent space. A pretrained diffusion backbone produces a single coherent scene representation, while a lightweight conditional latent to-latent head deterministically maps it to exposure-specific representations. This enables the generation of a dense, structurally consistent exposure stack in a single pass. This design eliminates multi-pass diffusion, ensures cross-exposure alignment, and enables scalable HDR synthesis. LatentHDR supports both textand image-conditioned HDR generation for perspective and panoramic scenes. Experiments on synthetic data and the SI-HDR benchmark show that LatentHDR achieves state-of-the-art dynamic range with competitive perceptual quality, while reducing computation by an order of magnitude. Our results demonstrate that high-quality HDR generation can be achieved through structured latent modeling, challenging the need for stochastic multi-exposure generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。