用高斯基元替代隐式神经表示,让医学影像重建更快更省资源。
Implicit representations are dead. Long live explicit primitives!

- 用局部高斯基元替代全局神经网络,实现高效渲染
- 在显微和肺CT数据上,重建质量不输且优化时间更短
- 适合需要快速处理高分辨率医学影像的研究者
连续参数化医学数据已成为实现分辨率无关图像表示的强大范式。虽然隐式神经表示(INRs)具备高保真度与紧凑存储优势,但其依赖全局多层感知机导致计算成本高、内存占用大、优化耗时长。随着医学影像向更高分辨率、更精细结构发展,这些开销严重制约了隐式方法的应用。近期,基于高斯的显式基元彻底革新了表示学习范式,将深度网络评估替换为局部化、可光栅化的基元。本文对高斯表示与隐式方法在医学影像中的表现进行了跨维度全面评估。首先,从数学性质上分析显式基元超越隐式范式的潜力;随后,在2D显微组织切片与3D肺部计算机断层扫描(CT)两个高挑战性数据集上进行基准测试。实验表明,高斯表示在所有压缩因子下均达到或超过隐式方法的重建指标,同时显著降低优化时间与内存需求。结合显式基元出色的数学特性,研究结果推动高斯表示的广泛应用,并为其在医学影像领域的发展提供新方向。
原文摘要 · Abstract (English)
Continuous parameterization of medical data has emerged as a powerful paradigm for resolution-independent image representation. While Implicit Neural Representations offer high fidelity and compact storage, their reliance on global Multi-Layer Perceptrons incurs sizeable computational costs, large memory requirements, and extensive optimization times. As medical imaging trends towards ever-more detailed, high-resolution volumes, these costs impose significant bottlenecks in the applicability of implicit approaches. Recently, explicit Gaussian-based primitives have revolutionized the representation learning paradigm by trading deep network evaluations for localized, rasterization-friendly primitives. In this paper, we present a comprehensive, cross-dimensional evaluation of Gaussian representations against implicit approaches for medical imaging applications. First, we outline a theoretical overview on the mathematical properties offered by explicit primitives beyond what is capable under the implicit neural paradigm. Subsequently, we benchmark the computational performance on two demanding image datasets: 2D microscopy histology and 3D lung Computed Tomography (CT). Our experiments demonstrate that Gaussian representations consistently match or surpass reconstruction metrics compared to implicit methods across all compression factors, while displaying significantly lower optimization times, and memory requirements. Together with the compelling mathematical properties offered by explicit primitives, these findings motivate the wider adoption of Gaussian representations and position them as an attractive direction for future research in medical imaging.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。