arXiv:2512.10293cs.CV2025-12

从单张图生成带物理真实感的360°全景视图,无需微调或昂贵模拟。

Physically Aware 360$^\circ$ View Generation from a Single Image using Disentangled Scene Embeddings

  • 分离各向同性和各向异性光照贡献,用双分支条件控制不同场景。
  • 在多个数据集上SSIM和LPIPS优于现有方法,支持实时交互应用。
  • 适合医疗可视化、机器人感知与沉浸式内容创作,通用性强。

我们提出Disentangled360,一种创新的3D感知技术,结合方向解耦体渲染与单图像360°视角合成优势,应用于医学成像与自然场景重建。相比现有方法对各向异性光行为的简化或跨场景泛化不足,本框架在高斯点云渲染主干中明确区分各向同性与各向异性贡献。采用双分支条件机制:一用于基于CT强度驱动的体积数据散射建模,另一通过归一化相机嵌入处理真实世界RGB场景。为解决尺度模糊并保持结构真实感,设计混合无姿态锚定方法,自适应采样场景深度与材质变化,作为场景蒸馏过程中的稳定基准。该设计集成术前放射影像仿真与消费级360°渲染于单一推理流程,实现快速、逼真的有向视图生成。在Mip-NeRF 360、RealEstate10K和DeepDRR数据集上的评估显示其在SSIM与LPIPS指标上表现更优,运行时测试验证其适用于交互式应用。Disentangled360可支持混合现实医疗监管、机器人感知与沉浸式内容生成,无需针对场景微调或昂贵光子模拟。

原文摘要 · Abstract (English)

We introduce Disentangled360, an innovative 3D-aware technology that integrates the advantages of direction disentangled volume rendering with single-image 360° unique view synthesis for applications in medical imaging and natural scene reconstruction. In contrast to current techniques that either oversimplify anisotropic light behavior or lack generalizability across various contexts, our framework distinctly differentiates between isotropic and anisotropic contributions inside a Gaussian Splatting backbone. We implement a dual-branch conditioning framework, one optimized for CT intensity driven scattering in volumetric data and the other for real-world RGB scenes through normalized camera embeddings. To address scale ambiguity and maintain structural realism, we present a hybrid pose agnostic anchoring method that adaptively samples scene depth and material transitions, functioning as stable pivots during scene distillation. Our design integrates preoperative radiography simulation and consumer-grade 360° rendering into a singular inference pipeline, facilitating rapid, photorealistic view synthesis with inherent directionality. Evaluations on the Mip-NeRF 360, RealEstate10K, and DeepDRR datasets indicate superior SSIM and LPIPS performance, while runtime assessments confirm its viability for interactive applications. Disentangled360 facilitates mixed-reality medical supervision, robotic perception, and immersive content creation, eliminating the necessity for scene-specific finetuning or expensive photon simulations.

360°视图生成医学影像解耦表示高斯溅射

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。