arXiv:2605.31238cs.CLcs.LG2026-05被引 1

通过图约束筛选路径,高效构建大规模多跳推理训练数据。

Scaling Multi-Hop Training Data via Graph-Constrained Path Selection

论文配图:Scaling Multi-Hop Training Data via Graph-Constrained Path Selection
图 1 · 摘自论文原文
  • 分离路径生成与问题构造,先用图结构枚举合理推理路径。
  • 在80K法律合同数据上,闭卷准确率提升16.92个百分点至38.58%。
  • 适合需要海量高质量多跳推理数据的研究者,尤其法律、医疗领域。

赋予大语言模型对专业文档的组合推理能力,需大规模多跳训练数据,但此类数据在非结构化文本中极难获取。现有方法依赖单一教师模型同时发现证据路径并生成问答对,但在重复模板和密集交叉引用的文档中表现严重下降。本文将两步操作解耦:先在关键词聚类图上离线枚举路径,再由教师仅对预验证路径进行口语化表达。图结构施加五种几何可接受性约束,理论证明局部相似性仅能容忍端点偏移约91度,且必须设置上限以摆脱冗余文本形成的嵌入团簇。消融实验表明,在同等训练规模下,有无约束路径性能相当;全规模优势来自可用语料扩展4.4倍,而非单条路径质量提升——说明图约束核心作用是提升教师生成可行性。在CUAD法律合同语料库构建的8万条数据上微调Qwen3-32B,闭卷Token F1从21.66%升至38.58%。代码已开源。

原文摘要 · Abstract (English)

Endowing large language models with compositional reasoning over specialized documents requires multi-hop training data at scale, where such data rarely exists outside of curated benchmarks built on structured sources. To construct it directly from plain, unannotated text, existing methods ask a single teacher model to jointly discover an evidence path through a document and verbalize it as a question-answer pair. However, these methods degrade sharply when documents are structured around repetitive templates and densely cross-referencing clauses, conditions that characterize most real-world specialized corpora. In this work, we decouple the two operations: reasoning paths are enumerated offline over a graph of contextual keyword centroids, and the teacher is invoked only to verbalize pre-validated paths. The graph enforces five geometric admissibility constraints, for which we provide Gram-matrix arguments establishing that local similarity bounds alone admit endpoint drift up to ${\sim}91^{\circ}$, and that an upper similarity bound is necessary to exit dense embedding cliques formed by boilerplate text. A matched-size ablation isolates the mechanism: at equal training scale, constrained and unconstrained chains yield indistinguishable downstream performance, and the gain at full scale comes from a 4.4$\times$ expansion of the usable corpus rather than from higher per-chain quality -- reframing the role of graph constraints, in this setting, as raising teacher synthesizability rather than improving chain content. Fine-tuning Qwen3-32B on 80K examples constructed from the CUAD legal contract corpus improves closed-book Token F1 from 21.66% to 38.58%. We have released our codes at https://github.com/hkgai-official/GCSCS.

多跳推理知识增强数据构建图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。