让大模型理解物理规律,避免胡说八道。
OMNIFLOW: A Physics-Grounded Multimodal Agent for Generalized Scientific Reasoning
- 用语义符号对齐把图像转为物理结构描述
- 零样本和少样本任务上超越传统模型
- 适合需要可解释科学推理的领域
大型语言模型在逻辑推理上表现优异,但在由偏微分方程(PDEs)控制的连续时空动态中常出现非物理解释。现有方法多依赖昂贵的领域特定微调,严重限制跨领域泛化与可解释性。为此,我们提出OMNIFLOW,一种神经符号架构,无需参数更新即可将冻结的多模态大模型锚定在基本物理定律上。OMNIFLOW引入新颖的语义-符号对齐机制,将高维流张量投影为拓扑语言描述,使模型感知物理结构而非原始像素值。此外,构建基于物理引导的思维链(PG-CoT)工作流,通过动态约束注入(如质量守恒)和迭代反思验证实现推理协调。我们在涵盖微观湍流、理论纳维-斯托克斯方程和宏观全球天气预报的综合性基准上评估了OMNIFLOW。实证结果表明,其在零样本泛化与少样本适应任务中显著优于传统深度学习基线。关键的是,它能生成透明、物理一致的推理报告,标志着从黑箱拟合到可解释科学推理的范式转变。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have demonstrated exceptional logical reasoning capabilities but frequently struggle with the continuous spatiotemporal dynamics governed by Partial Differential Equations (PDEs), often resulting in non-physical hallucinations. Existing approaches typically resort to costly, domain-specific fine-tuning, which severely limits cross-domain generalization and interpretability. To bridge this gap, we propose OMNIFLOW, a neuro-symbolic architecture designed to ground frozen multimodal LLMs in fundamental physical laws without requiring domain-specific parameter updates. OMNIFLOW introduces a novel \textit{Semantic-Symbolic Alignment} mechanism that projects high-dimensional flow tensors into topological linguistic descriptors, enabling the model to perceive physical structures rather than raw pixel values. Furthermore, we construct a Physics-Guided Chain-of-Thought (PG-CoT) workflow that orchestrates reasoning through dynamic constraint injection (e.g., mass conservation) and iterative reflexive verification. We evaluate OMNIFLOW on a comprehensive benchmark spanning microscopic turbulence, theoretical Navier-Stokes equations, and macroscopic global weather forecasting. Empirical results demonstrate that OMNIFLOW significantly outperforms traditional deep learning baselines in zero-shot generalization and few-shot adaptation tasks. Crucially, it offers transparent, physically consistent reasoning reports, marking a paradigm shift from black-box fitting to interpretable scientific reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。