用高斯表示稀疏建模医学体积,实现高速精准可视化
Gaussian Volumetric Representation for Efficient Shear-Warp Visualization

- 基于高斯的稀疏体积表示,结合蒙特卡洛估计优化
- 仅用稀疏采样训练,达43.86帧/秒,压缩比11.31:1
- 适合需要快速渲染多模态医学数据的研究者
医学图像可视化需在保持解剖精度的同时实现高效渲染。针对大体积数据集的高计算成本问题,本文提出一种基于高斯的体积表示方法,可在不损失结构与辐射细节的前提下实现高效可视化。通过蒙特卡洛体积估计优化该表示,使模型仅需在稀疏体素子集上训练,仍能与密集体积目标保持一致。此外,引入课程学习策略,逐步融合基于切片的结构化采样:稀疏体素提供全局覆盖,切片样本捕捉空间相关区域,增强几何结构与纹理连续性。该组合使高斯表示能在稀疏监督下学习各类结构及对应纹理,显著降低密集体素处理的计算开销。所学表示支持切片式渲染方法(如shear-warp体积渲染),可高效可视化包括MRI和冷冻切片在内的多模态医学数据集,同时保留解剖结构。在稀疏监督下,本方法实现最高43.86帧/秒的渲染速度,压缩比达11.31:1。
原文摘要 · Abstract (English)
Medical image visualization requires volumetric rendering algorithms that preserve anatomical fidelity while maintaining high rendering speeds. To address the high computational cost of large volumetric datasets, we propose a Gaussian-based volumetric representation for efficient visualization of dense medical volumes without compromising structural and radiometric details. We optimize the proposed representation using Monte Carlo volumetric estimation, which enables training on a highly sparse subset of voxels while maintaining consistency with the dense volumetric objective. In addition, we introduce a curriculum learning strategy that progressively incorporates structured slice-based sampling during training. Sparse voxel samples provide an early global coverage of the volume, while slice samples capture spatially correlated regions that aid geometric structure and texture continuity. This combination enables the Gaussian representation to learn anatomical details of various structures and corresponding textures from sparse supervision while significantly reducing the computational cost associated with dense voxel processing. The learned representation supports slice-based rendering methods such as shear-warp volume rendering, enabling efficient visualization of multimodal medical datasets including MRI and Cryosection volumes while preserving anatomical structures. Using sparse supervision, our method achieves up to 43.86 FPS rendering with a compression ratio of 11.31:1.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。