arXiv:2502.14352cs.CL2025-02ACL被引 6

用自然语言描述结构化表示,让大模型更懂语义推理。

SR-LLM: Rethinking the Structured Representation in Large Language Model

  • 用自然语言提示融合结构信息,避免代码格式不匹配
  • 在PAWS数据集上提升12.38%,显著增强推理能力
  • 无需训练即可改进,适合提升模型逻辑理解

结构化表示(如抽象意义表示AMR)在计算语言学中长期重要,但在大语言模型(LLM)时代其作用尚不明确。早期尝试通过零样本方式将结构化表示引入LLM,性能反而下降。我们推测原因在于结构信息以模型训练语料不熟悉的代码格式输入。为此,提出SR-LLM框架,从无训练和有训练两个角度探索更优融合方式:前者通过自然语言描述嵌入提示,后者在语言化结构表示上微调模型。在多个下游数据集上均实现性能提升,尤其在PAWS上分别取得3.17%和12.38%的增益。据我们所知,这是首次证明结构化表示可显著提升LLM推理能力的工作,旨在启发未来研究利用结构数据增强大模型的推理与互操作性。

原文摘要 · Abstract (English)

Structured representations, exemplified by Abstract Meaning Representation (AMR), have long been pivotal in computational linguistics. However, their role remains ambiguous in the Large Language Models (LLMs) era. Initial attempts to integrate structured representation into LLMs via a zero-shot setting yielded inferior performance. We hypothesize that such a decline stems from the structure information being passed into LLMs in a code format unfamiliar to LLMs' training corpora. Consequently, we propose SR-LLM, an innovative framework with two settings to explore a superior way of integrating structured representation with LLMs from training-free and training-dependent perspectives. The former integrates structural information through natural language descriptions in LLM prompts, whereas its counterpart augments the model's inference capability through fine-tuning on linguistically described structured representations. Performance improvements were observed in widely downstream datasets, with particularly notable gains of 3.17% and 12.38% in PAWS. To the best of our knowledge, this work represents the pioneering demonstration that leveraging structural representations can substantially enhance LLMs' inference capability. We hope that our work sheds light and encourages future research to enhance the reasoning and interoperability of LLMs by structure data.

结构化表示大模型推理自然语言提示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。