arXiv:2511.18600cs.CV2025-11中稿 · CVPR被引 3

让神经资产与渲染器协同设计,实现更真实、可重光照的3D生成。

NeAR: Coupled Neural Asset-Renderer Stack

  • 资产与渲染器联合优化,形成可互信的生成契约。
  • 能从单张随意光照图生成无阴影的统一表征,支持实时重光照。
  • 适合做高质量3D内容生成与跨视角重光照的研究者。

神经资产生成与神经渲染传统上是分离的范式:前者生成适配固定图形管线的数字资产,后者将常规资产映射为图像。但将其视为独立实体限制了保真度与一致性上的端到端优化。本文提出NeAR——耦合神经资产-渲染堆栈,主张联合设计资产表示与渲染器可建立更强的生成“契约”。在资产侧,引入光照归一化SLAT(LH-SLAT),利用修正流模型将随意光照的单图提升至无光照影响的规范隐空间,有效抑制嵌入的阴影与高光;在渲染侧,设计光照感知神经解码器,可基于HDR环境图与相机视角实时合成可重光照的3D高斯泼溅,无需逐对象优化。我们在四个任务上验证:(1) 基于G-buffer的正向渲染,(2) 随机光照重建,(3) 未知光照重光照,(4) 新视角重光照。大量实验表明,该耦合堆栈在量化指标与感知质量上均优于当前最佳基线。我们希望这一耦合视角能启发未来将神经资产与渲染器视为共设计组件而非独立实体的图形系统。

原文摘要 · Abstract (English)

Neural asset authoring and neural rendering have traditionally evolved as disjoint paradigms: one generates digital assets for fixed graphics pipelines, while the other maps conventional assets to images. However, treating them as independent entities limits the potential for end-to-end optimization in fidelity and consistency. In this paper, we bridge this gap with NeAR, a Coupled Neural Asset--Renderer Stack. We argue that co-designing the asset representation and the renderer creates a robust "contract" for superior generation. On the asset side, we introduce the Lighting-Homogenized SLAT (LH-SLAT). Leveraging a rectified-flow model, NeAR lifts casually lit single images into a canonical, illumination-invariant latent space, effectively suppressing baked-in shadows and highlights. On the renderer side, we design a lighting-aware neural decoder tailored to interpret these homogenized latents. Conditioned on HDR environment maps and camera views, it synthesizes relightable 3D Gaussian splats in real-time without per-object optimization. We validate NeAR on four tasks: (1) G-buffer-based forward rendering, (2) random-lit reconstruction, (3) unknown-lit relighting, and (4) novel-view relighting. Extensive experiments demonstrate that our coupled stack outperforms state-of-the-art baselines in both quantitative metrics and perceptual quality. We hope this coupled asset-renderer perspective inspires future graphics stacks that view neural assets and renderers as co-designed components instead of independent entities.

3D生成神经渲染重光照高斯泼溅

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。