arXiv:2606.12318cs.LGcs.AI2026-06被引 2

让冻结的科学模型通过推理链自动拆解复杂问题,无需调参即可应对新场景。

Chain of Operators: An Inference-Time Harness for In-Context Operator Learning

论文配图:Chain of Operators: An Inference-Time Harness for In-Context Operator Learning
图 1 · 摘自论文原文
  • 用可解释的操作序列引导模型,将未知问题分解为数学运算步骤
  • 在偏微分方程与空气质量预测任务中,推理误差显著低于直接调用
  • 操作链可跨物理方程类型泛化,适合需要可靠推理的科研计算场景

尽管科学基础模型在加速物理模拟和数值预测方面前景广阔,但在分布外(OOD)场景下仍表现脆弱。传统适应复杂OOD任务需昂贵的参数微调。语言AI中通过推理链等外部支架实现免调参适配,但物理领域尚无对应方案。本文提出链式操作(CHOP)框架,利用上下文学习能力,将冻结的基础模型引导至复杂OOD任务,无需更新任何权重。通过在上下文内调用操作网络(ICON),CHOP系统性地将陌生问题拆解为一系列显式的闭式数学操作与多次模型调用,将分布外查询重新映射回模型已学的运行区间。在多种基准测试中,包括经典偏微分方程与真实空气污染预测任务,相比直接模型评估,CHOP持续显著降低推理误差。关键在于,这些模块化操作链完全可解释,并能跨完全不同的物理方程族泛化。本工作证明了冻结科学模型可通过可编程推理实现自适应,建立了一种模块化、可扩展的智能科学计算范式。

原文摘要 · Abstract (English)

While scientific foundation models show immense promise in accelerating physical simulations and numerical forecasting, they remain notoriously brittle when encountering out-of-distribution (OOD) scenarios. Adapting these generalist models to complex OOD tasks typically requires expensive parameter fine-tuning. In linguistic AI, this bottleneck is bypassed using "harnesses", which serve as external scaffolding such as reasoning chains and tool use to adapt frozen weights to complex tasks, yet designing an equivalent harness for physical domains remains an open frontier. To bridge this gap, we introduce Chain of Operators (CHOP), a framework that guides a frozen foundation model through complex OOD tasks without updating a single weight. By exploiting the in-context learning capability of In-Context Operator Networks (ICON), CHOP systematically decomposes unfamiliar problems into a sequence of explicit, closed-form mathematical operations and multiple model calls, translating OOD queries back into the model's learned operating regime. Across diverse benchmarks, including canonical PDE problems and real-world air-quality forecasting, CHOP consistently and substantially reduces inference errors compared to direct model evaluation. Crucially, these modular operator chains remain fully interpretable and can generalize across entirely distinct families of physical equations. Ultimately, this work demonstrates how frozen scientific models can adapt through programmable inference, establishing a modular, potential paradigm for agentic scientific computing.

科学计算推理链零样本可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。