arXiv:2608.31028stat.MLcs.LG2026-08

通过科学先验构建训练分布,学习可解释的微分方程潜在表示。

Learning the Geometry of Admissible Hypotheses through Inductive Bias in Training Distributions

论文配图:Learning the Geometry of Admissible Hypotheses through Inductive Bias in Training Distributions
图 1 · 摘自论文原文
  • 将物理合理性等科学先验嵌入训练数据分布,生成结构化假设集。
  • 11维潜空间可准确重构多种典型偏微分方程,且族内族间过渡平滑。
  • 引入科学先验显著降低方程形式误判和参数估计误差,适合方程推断任务。

科学发现常需在与实验观测一致的多个竞争性假设中进行推理。对于混合变量与组合型假设空间,构建概率表示仍具挑战,因活跃模型组件及其参数均未知。本文提出一种框架,通过将科学归纳偏置直接嵌入训练分布,学习可接受偏微分方程(PDE)的连续潜在表示。逐步引入更丰富的结构原则(如稀疏性、逻辑依赖、常见PDE族、物理可接受性),生成结构化假设分布,由门控变分自编码器从中学习连续潜流形。实验表明,该11维表示能准确重构广泛代表性的PDE集合,且在方程家族内部及之间均呈现平滑几何过渡。消融实验证明,引入科学原则可减少方程形式误分类,并降低在代表性基准集上重构时的参数估计误差。结果表明,将科学归纳偏置嵌入训练分布,可实现紧凑且几何有意义的假设流形学习,为未来对竞争性控制方程的推理提供原理性基础。

原文摘要 · Abstract (English)

Scientific discovery often requires reasoning over competing hypotheses that are consistent with experimental observations. For mixed-variable and combinatorial hypothesis spaces, however, constructing probabilistic representations remains challenging because both the active model components and their associated parameters are unknown. In this work, we present a framework for learning continuous latent representations of admissible partial differential equations (PDEs) by embedding a scientific inductive bias directly into the training distribution. Progressively richer structural principles (e.g., sparsity, logical dependencies, common PDE families, and physical admissibility) are used to generate a structured distribution of hypotheses from which a gated variational autoencoder learns a continuous latent manifold. Experimental results show that the resulting 11-dimensional representation accurately reconstructs a broad collection of representative PDEs, while exhibiting smooth geometric transitions both within and across equation families. Through an ablation study we further demonstrate that introducing scientific principles reduces both structural misclassifications of equation forms and parameter estimation errors when reconstructing a representative benchmark set of admissible partial differential equations. These results show that embedding a scientific inductive bias in the training distribution enables the learning of compact and geometrically meaningful hypothesis manifolds, providing a principled foundation for future inference over competing governing equations.

偏微分方程潜在表示科学先验生成建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。