arXiv:2506.21575cs.CLcs.AI2025-06被引 7

用强化学习统一训练大模型,同时搞定表格和图数据的语义解析。

STRuCT-LLM: Unifying Tabular and Graph Reasoning with Reinforcement Learning for Semantic Parsing

  • 通过强化学习联合优化文本转SQL与文本转Cypher任务。
  • 最大模型在Spider上提升13.5%,在Text2Cypher上提升73.1%。
  • 无需共享模式即可跨形式迁移,适合做多模态数据理解的研究者。

我们提出STRuCT-LLM,一种统一框架,用于训练大语言模型对关系型和图结构数据进行结构化推理。该方法结合强化学习与思维链监督,联合优化文本到SQL和文本到Cypher任务。为支持图解析的细粒度优化,引入基于图编辑距离的拓扑感知奖励函数。不同于以往将关系与图形式分开处理的工作,STRuCT-LLM利用SQL与Cypher之间的共享抽象,实现跨形式迁移,即使无共享模式下也能互相提升。最大模型(QwQ-32B)在语义解析任务中取得显著提升:Spider提升13.5%,Text2Cypher提升73.1%。模型还展现出强零样本泛化能力,在下游表格问答(TableBench:+8.5%)和知识图谱问答(CR-LT-KGQA:+1.7%)上无需特定监督即获提升。结果表明可执行查询作为结构化推理的支架有效,且联合训练SQL与Cypher具有协同增益(代码见https://github.com/bouv/STRuCT-LLM)。

原文摘要 · Abstract (English)

We propose STRuCT-LLM, a unified framework for training large language models (LLMs) to perform structured reasoning over both relational and graph-structured data. Our approach jointly optimizes Text-to-SQL and Text-to-Cypher tasks using reinforcement learning (RL) combined with Chain-of-Thought (CoT) supervision. To support fine-grained optimization in graph-based parsing, we introduce a topology-aware reward function based on graph edit distance. Unlike prior work that treats relational and graph formalisms in isolation, STRuCT-LLM leverages shared abstractions between SQL and Cypher to induce cross-formalism transfer, enabling SQL training to improve Cypher performance and vice versa - even without shared schemas. Our largest model (QwQ-32B) achieves substantial relative improvements across tasks: on semantic parsing, Spider improves by 13.5\% and Text2Cypher by 73.1\%. The model also demonstrates strong zero-shot generalization, improving performance on downstream tabular QA (TableBench: 8.5\%) and knowledge graph QA (CR-LT-KGQA: 1.7\%) without any QA-specific supervision. These results demonstrate both the effectiveness of executable queries as scaffolds for structured reasoning and the synergistic benefits of jointly training on SQL and Cypher (code available at https://github.com/bouv/STRuCT-LLM).

语义解析图神经网络强化学习大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。