用可验证的符号规则系统提升AI解化学题的透明度与准确率
A Task-Centric Ontology and Deterministic Domain Rules as a Verifiable Core for AI-Assisted Chemistry Problem Solving

- 基于任务构建化学概念本体,聚焦中学化学解题所需知识
- 在300道题中准确率达98.67%,规则部分达98.88%正确
- 适合需要可解释性与高可靠性的化学教育AI系统开发者
大语言模型虽能理解自然语言化学问题,但其内部推理难以审视、约束与验证。本文提出ChemOntoRule,一个面向中学化学问题求解的符号化核心原型。核心设计为任务导向的本体工程:本体围绕特定化学问题集合所需的概念、属性、关系及可执行过程构建,而非通用化学表示。实现的系统结合轻量级JSON与RDF/Turtle格式本体,以及针对电子结构、周期律、氧化态、氧化物与氢化物行为等中学层级推理模式的确定性Python规则。对于未被通用规则覆盖的问题类别,采用专家手动编码的备用方案。系统在300道人工编写并人工验证的化学题上测试,整体匹配296道参考答案(98.67%);本体驱动的规则子系统覆盖269题,匹配266道(98.88%);31题由特定任务专家代码处理,其中30题匹配。因本体构建与评估使用同一数据集,结果反映实现覆盖率与内部一致性,非独立泛化能力。分析4处不匹配,区分结构验证与化学正确性,并提出未来架构:语言模型主要作为用户语言到标准化本体任务框架的转换器。令牌效率作为未来可控研究的可检验假设,非当前工作结果。
原文摘要 · Abstract (English)
Large language models can interpret natural-language chemistry questions, but their internal reasoning is difficult to inspect, constrain, and validate. This paper presents ChemOntoRule, a proof-of-concept symbolic core for AI-assisted school-level chemistry problem solving. The central design choice is task-centric ontology engineering: the ontology is constructed around the concepts, properties, relations, and executable procedures required by a defined collection of chemistry problems, rather than as a universal representation of chemistry. The implemented artifact combines a lightweight ontology serialized in JSON and RDF/Turtle with deterministic Python rules for electronic structure, periodic trends, oxidation states, oxide and hydride behavior, and related school-level reasoning patterns. A separate expert-coded fallback handles problem families not yet represented by general rules. The system was examined on 300 human-authored and manually validated chemistry problems. The complete system matched 296 of 300 reference answers (98.67%). The ontology-driven rule subset covered 269 problems and matched 266 references (98.88%); 31 problems were handled by task-specific expert-coded fallbacks, with 30 matches. Because the same collection informed ontology construction and evaluation, these results measure implemented coverage and internal consistency, not independent generalization. We analyze the four mismatches, distinguish structural validation from chemical correctness, and define a future architecture in which a language model acts primarily as a translator from user language into a normalized ontological task frame. Token efficiency is presented as a testable hypothesis for future controlled studies, not as a result of the current work.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。