用周边高斯点云+中心路径追踪,实现沉浸式医学影像实时交互可视化
Hybrid Foveated Path Tracing with Peripheral Gaussians for Immersive Anatomy
- 中心聚焦路径追踪+周边高斯点云混合渲染
- 周边模型生成<1秒完成,支持实时更新
- 适合需要实时交互的医学教学与手术规划
体数据医学成像在理解复杂病灶方面潜力巨大,但传统二维切片难以支持空间关系解读,需用户自行构建三维认知。直接体渲染和虚拟现实呈现虽可改善感知,但计算开销大;预计算方法如高斯溅射则需提前规划,限制交互性。本文提出一种混合渲染方案,结合流式聚焦路径追踪与轻量级高斯溅射的周边近似,利用体数据优化周边模型生成,并通过中央渲染结果持续精炼,实现交互式更新。深度引导重投影提升对延迟的鲁棒性,使用户可在保真度与刷新率间灵活权衡。相比直接路径追踪和高斯溅射,本方法在不到一秒内完成周边模型重建,避免了繁复预处理和近似,为交互式医学可视化开辟新可能。
原文摘要 · Abstract (English)
Volumetric medical imaging offers great potential for understanding complex pathologies. Yet, traditional 2D slices provide little support for interpreting spatial relationships, forcing users to mentally reconstruct anatomy into three dimensions. Direct volumetric path tracing and VR rendering can improve perception but are computationally expensive, while precomputed representations, like Gaussian Splatting, require planning ahead. Both approaches limit interactive use. We propose a hybrid rendering approach for high-quality, interactive, and immersive anatomical visualization. Our method combines streamed foveated path tracing with a lightweight Gaussian Splatting approximation of the periphery. The peripheral model generation is optimized with volume data and continuously refined using foveal renderings, enabling interactive updates. Depth-guided reprojection further improves robustness to latency and allows users to balance fidelity with refresh rate. We compare our method against direct path tracing and Gaussian Splatting. Our results highlight how their combination can preserve strengths in visual quality while re-generating the peripheral model in under a second, eliminating extensive preprocessing and approximations. This opens new options for interactive medical visualization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。