用专用语言提升神经PDE求解器自动生成效率
Improving Auto-Design of Neural PDE Solvers with a Domain-Specific Language
- 构建领域专用语言抽象求解器设计决策,屏蔽底层代码细节
- 前10轮进化迭代优化成功率提升超52%,搜索更稳定高效
- 适合做自动算法设计或科学计算的开发者参考
神经PDE求解器的自动生成本质上是搜索空间表示问题。在无约束的Python程序空间中,有效求解器仅占极小比例:多数候选程序存在语法错误、语义冲突或数值不稳定性。直接生成代码导致大模型将大量搜索资源消耗于实现失败,而非求解器质量推理。ADSL-PDE通过在求解器概念与可执行代码间引入结构化搜索状态,抽象表达决定神经PDE求解器的核心设计(架构、物理约束、目标函数、采样策略、优化方式),同时隐藏低层实现细节。一个确定性编译器将每个合法搜索状态映射为可执行求解器。该方法重塑搜索空间:剔除大量无效程序区域,提高有效候选密度,并保留组合自由度以发现全新设计。求解器演化得以基于设计决策而非代码片段进行。基于此表示,我们的进化代理通过实证反馈持续提出、评估与优化搜索状态。在多个PDE基准测试中,ADSL-PDE显著提升搜索效率与优化稳定性,前10轮进化迭代中性能提升超过52%。结果表明:有效的LLM驱动自动设计不仅依赖更强推理能力,更需聚焦于合法且关键决策的搜索表示。
原文摘要 · Abstract (English)
Neural PDE solver auto-design is fundamentally a search-space representation problem. In the space of unrestricted Python programs, valid solvers form an extremely sparse subset: most candidate programs are syntactically incorrect, semantically incompatible, or numerically unstable. Direct code generation therefore forces an LLM to spend most of its search capacity navigating implementation failures rather than reasoning about solver quality. ADSL-PDE addresses this challenge by introducing a structured search state between solver concepts and executable code. It represents the functional decisions that determine a neural PDE solver (architecture, physical constraints, objectives, sampling, and optimization) while abstracting away low-level implementation details. A deterministic compiler maps each valid search state to an executable solver. In effect, ADSL-PDE reshapes the search space: it removes large regions of invalid programs, increases the density of meaningful candidates, and preserves the compositional freedom needed to discover previously unseen designs. Solver evolution can thus operate over design decisions rather than code artifacts. Built on this representation, our evolutionary agent iteratively proposes, evaluates, and refines solver search states using empirical feedback. Across multiple PDE benchmarks, ADSL-PDE improves both search efficiency and optimization stability, achieving an improvement of more than 52% within the first ten evolution iterations. These results suggest a broader principle for LLM-driven auto-design: effective agents do not merely require stronger reasoning, but rather a search representation that concentrates exploration on valid and consequential decisions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。