用统一框架实现大规模医学神经场训练,提升效率与泛化能力。
MedFuncta: A Unified Framework for Learning Efficient Medical Neural Fields
- 将医学数据编码为1D隐向量,调制共享神经场实现跨数据集泛化
- 引入可变频率参数ω,提升学习动态并优化各层学习率
- 稀疏监督元学习策略降低显存与计算开销,适合资源受限场景
医学影像研究主要依赖离散数据表示,难以随网格分辨率扩展,且无法充分捕捉信号的连续性。神经场(NFs)通过将数据建模为连续函数提供了有力替代方案。尽管单实例神经场已在医学领域取得成功,但将其扩展至大规模医学数据集仍面临挑战。为此,我们提出MedFuncta,一个面向多样化医学信号的大规模神经场统一训练框架。基于Functa,我们的方法将数据编码为1D隐向量,调制一个共享的元学习神经场,实现跨数据集泛化。我们重新审视常见设计选择,引入广泛使用的SIREN激活函数中的非恒定频率参数$ω$,并建立该$ω$-调度与层间学习率之间的关联,其发现与近期理论学习动态研究相呼应。此外,我们提出一种可扩展的元学习策略,训练中采用稀疏监督,显著降低内存消耗与计算开销,同时保持竞争力。我们在多样化的医学数据集上评估了MedFuncta,并展示了如何在神经数据表示上解决相关下游任务。为促进该方向的研究,我们发布了代码、模型权重及首个大规模数据集MedNF,包含超过50万条隐向量,支持多实例医学神经场研究。
原文摘要 · Abstract (English)
Research in medical imaging primarily focuses on discrete data representations that poorly scale with grid resolution and fail to capture the often continuous nature of the underlying signal. Neural Fields (NFs) offer a powerful alternative by modeling data as continuous functions. While single-instance NFs have successfully been applied in medical contexts, extending them to large-scale medical datasets remains an open challenge. We therefore introduce MedFuncta, a unified framework for large-scale NF training on diverse medical signals. Building on Functa, our approach encodes data into a unified representation, namely a 1D latent vector, that modulates a shared, meta-learned NF, enabling generalization across a dataset. We revisit common design choices, introducing a non-constant frequency parameter $ω$ in widely used SIREN activations, and establish a connection between this $ω$-schedule and layer-wise learning rates, relating our findings to recent work in theoretical learning dynamics. We additionally introduce a scalable meta-learning strategy for shared network learning that employs sparse supervision during training, thereby reducing memory consumption and computational overhead while maintaining competitive performance. Finally, we evaluate MedFuncta across a diverse range of medical datasets and show how to solve relevant downstream tasks on our neural data representation. To promote further research in this direction, we release our code, model weights and the first large-scale dataset - MedNF - containing > 500 k latent vectors for multi-instance medical NFs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。