arXiv:2605.16351cs.LGcs.AI2026-05

让神经模型学会物理时间尺度,提升科学数据迁移稳定性。

PIMSM: Physics-Informed Multi-Scale Mamba for Stable Neural Representations under Distribution Shift

论文配图:PIMSM: Physics-Informed Multi-Scale Mamba for Stable Neural Representations under Distribution Shift
图 1 · 摘自论文原文
  • 引入物理时标对齐机制,用频谱拐点指导多尺度离散化。
  • 在脑影像和气象数据上均显著降低分布外泛化时的表征漂移。
  • 适合需要跨场景稳定推理的科学领域模型开发。

科学基础模型需在数据集、采集协议和部署域变化下复用表征,但多数序列骨干网络将科学时间结构视为无约束模式进行拟合。我们指出,自然动力系统的核心特性被忽略:神经与大气时间序列由跨多物理时标的相互作用过程组织,未能保留这种多尺度结构是分布外性能脆弱的原因。我们将其归因于时间核失配——模型在分布内拟合动态时采用的隐式记忆策略未锚定信号的物理时标,导致表征漂移与迁移退化。提出物理信息多尺度Mamba(PIMSM),该状态空间架构将频谱估计的频率分段拐点(膝点频率)映射为尺度特定的离散化参数,并锚定至采样时间单位。在人类连接组计划fMRI数据上,PIMSM在严重时间上下文截断、极端低资源迁移及静息态到任务态泛化中均提升鲁棒性与表征稳定性。无需模态特异性适配,同一架构在Weather-5K的留出站点空间分布外预测中,所有报告时间步长与变量的逐变量均方误差最低。这些结果支持时间尺度对齐作为科学基础模型在部署偏移下保持结构而非仅拟合相关性的实用归纳偏置。

原文摘要 · Abstract (English)

Scientific foundation models are expected to reuse representations under changes in dataset, acquisition protocol, and deployment domain, yet many sequence backbones treat scientific temporal structure as an unconstrained pattern to be fitted. We argue that this misses a central property of natural dynamical systems: neural and atmospheric time series are organized by interacting processes across multiple physical timescales, and failure to preserve this multiscale structure contributes to brittleness under distribution shift. We formalize this failure mode as temporal kernel mismatch, where a model fits in-distribution dynamics with an effective memory policy that is not anchored to the signal's physical timescales, leading to representation drift and degraded transfer. We propose Physics-Informed Multi-Scale Mamba (PIMSM), a state-space architecture that maps spectrum-estimated transition points between frequency regimes (knee frequencies) to scale-specific discretization parameters and anchors them to acquisition time units. On Human Connectome Project fMRI, PIMSM improves robustness and representation stability under severe temporal-context truncation, extreme low-resource transfer, and resting-state-to-task-state generalization. Without modality-specific adaptation, the same architecture also attains the lowest variable-wise MAE across all reported horizons and variables on Weather-5K held-out-station spatial out-of-distribution forecasting. These results support temporal-scale alignment as a practical inductive bias for scientific foundation models that must preserve structure, not only fit correlations, under deployment shift.

多尺度建模科学模型时序稳定

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。