用物理动力学构建医学图像分析新框架,提升分割与分类效果。
HamVision: Hamiltonian Dynamics as Inductive Bias for Medical Image Analysis
- 以阻尼谐振子动态作为结构化先验,自动提取内容、边界和显著性特征。
- 分割任务在多个数据集上达到最优Dice分数,参数仅857万,分类精度超主流模型。
- 无需额外训练即可适配不同任务,适合医疗影像研究者快速部署与验证。
我们提出HamVision,一种基于阻尼谐振子(damped harmonic oscillator)的医学图像分析框架,该振子是信号处理的基本构件,作为结构化归纳偏置用于分割与分类任务。其相空间分解产生三个功能独立的表示:位置 $q$(特征内容)、动量 $p$(编码边界与纹理的空间梯度)、能量 $H = \tfrac{1}{2}|z|^2$(无参显著图)。这些表示由动力学自然生成,无需监督,可被不同任务头直接利用而无需修改振子本身。对于分割,能量门控跳跃连接,动量在解码器每层注入边界信息(HamSeg);对于分类,三者全局池化后拼接为相空间特征向量(HamCls)。我们在十项跨五种成像模态的医学图像基准上评估。分割方面,HamSeg在ISIC 2018(89.38%)、ISIC 2017(88.40%)、TN3K(87.05%)和ACDC(92.40%)上达当前最优,仅用857万参数。分类方面,HamCls在BloodMNIST(98.85%)、PathMNIST(96.65%)上达最优,其余MedMNIST数据集表现优于MedMamba与MedViT。诊断分析证实,动量始终编码内部>边界>外部梯度,能量图与判别区域高度相关,这些性质完全源自哈密顿动力学。代码已公开于https://github.com/Minds-R-Lab/hamvision。
原文摘要 · Abstract (English)
We present HamVision, a framework for medical image analysis that uses the damped harmonic oscillator, a fundamental building block of signal processing, as a structured inductive bias for both segmentation and classification tasks. The oscillator's phase-space decomposition yields three functionally distinct representations: position~$q$ (feature content), momentum~$p$ (spatial gradients that encode boundary and texture information), and energy $H = \tfrac{1}{2}|z|^2$ (a parameter-free saliency map). These representations emerge from the dynamics, not from supervision, and can be exploited by different task-specific heads without any modification to the oscillator itself. For segmentation, energy gates the skip connections while momentum injects boundary information at every decoder level (HamSeg). For classification, the three representations are globally pooled and concatenated into a phase-space feature vector (HamCls). We evaluate HamVision across ten medical imaging benchmarks spanning five imaging modalities. On segmentation, HamSeg achieves state-of-the-art Dice scores on ISIC\,2018 (89.38\%), ISIC\,2017 (88.40\%), TN3K (87.05\%), and ACDC (92.40\%), outperforming most baselines with only 8.57M parameters. On classification, HamCls achieves state-of-the-art accuracy on BloodMNIST (98.85\%) and PathMNIST (96.65\%), and competitive results on the remaining MedMNIST datasets against MedMamba and MedViT. Diagnostic analysis confirms that the oscillator's momentum consistently encodes an interior$\,{>}\,$boundary$\,{>}\,$exterior gradient for segmentation and that the energy map correlates with discriminative regions for classification, properties that emerge entirely from the Hamiltonian dynamics. Code is available at https://github.com/Minds-R-Lab/hamvision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。