arXiv:2608.18593cs.CV2026-08

用一张图生成任意视角、焦距和摄影效果的新照片,效果逼真且快速。

ReX-Shot: Single-Image Rephotography via Geometry- and Camera-Grounded Generation

论文配图:ReX-Shot: Single-Image Rephotography via Geometry- and Camera-Grounded Generation
图 1 · 摘自论文原文
  • 基于3D几何与相机参数的生成框架,统一控制视角、焦距和光影效果。
  • 在保持内容一致性的前提下,实现近实时的交互式重拍摄生成。
  • 首次实现单图同时控制三要素,适合影视创作与虚拟拍摄场景。

单图重拍摄旨在仅凭一张参考图像,生成具有指定视角、焦距和摄影效果的新画面,而这些因素在成像中本就紧密耦合。现有方法通常将它们分开处理,在联合控制时表现不佳:新视角合成在焦距变化下易引入几何失真;超分辨率与指令引导编辑仍局限于2D,难以可靠扩展至新视角下的细节恢复与外观控制。我们归因于不完善的单图3D重建和连续焦距放大的采样限制。为减少几何误差带来的投影偏差,采用隐式变换的基座模型特征实现鲁棒的目标视角引导。进一步将焦距放大建模为几何引导的超分辨率问题,并利用生成式细节先验恢复稀疏3D重采样丢失的细节。在此3D感知生成骨干基础上,将摄影效果控制从2D滤波提升至3D感知的外观编辑,跨视角与焦距保持内容一致性。上述组件构成ReX-Shot——首个可从单图联合控制视角、焦距与参数化摄影效果的统一框架。实验表明,ReX-Shot在三项控制上均优于代表性基线,并支持近实时交互式重拍摄。

原文摘要 · Abstract (English)

Single-image rephotography aims to synthesize new shots of a scene from a single reference image with specified viewpoints, focal lengths, and photographic effects, which are intrinsically coupled in imaging. Existing methods typically treat these factors separately and struggle under joint control: novel-view synthesis may introduce geometric distortions under focal-length changes, while super-resolution and instruction-guided editing remain confined to 2D and cannot reliably extend detail restoration or appearance control to novel viewpoints. We attribute these limitations to imperfect single-image 3D reconstruction and the sampling limit of continuous focal-length enlargement. To reduce projection bias from geometric errors, we use implicitly transformed foundation-model features for robust target-view guidance. We further formulate focal-length enlargement as a geometry-guided super-resolution problem and exploit generative detail priors to recover details lost during sparse 3D resampling. Built on this 3D-aware generative backbone, we lift photographic-effect control from 2D filtering to 3D-aware appearance editing, preserving content consistency across viewpoints and focal lengths. These components form ReX-Shot, a geometry- and camera-grounded generative framework for single-image rephotography. To our knowledge, ReX-Shot is the first unified framework to jointly control viewpoint, focal length, and parameterized photographic effects from a single image. Experiments show that ReX-Shot outperforms representative baselines across all three controls while enabling near-real-time interactive rephotography.

图像生成重拍摄3D感知相机控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。