arXiv:2603.06635cs.LG2026-03

小模型难准确推断图结构属性,但表达方式和推理策略能显著影响表现。

Graph Property Inference in Small Language Models: Effects of Representation and Reasoning Strategy

  • 用邻接表比边列表更少出错,排序一致性更高。
  • 多分支推理在所有配置下均带来可测量的性能提升。
  • 无微调时小模型推断图属性仍不可靠,但设计选择有影响。

近期语言建模进展拓展了自然语言接口可处理的任务范围,包括需要结构化推理的问题。然而,当关系结构以文本形式呈现时,小型语言模型在推断图论性质方面的有效性仍不明确。本文对三种小指令微调语言模型在多种局部与全局图度量上的图论属性推断进行了系统研究,分离输入表示与推理策略的作用。结果显示,小模型无法实现可靠的图属性估计:归一化误差始终超过目标属性的内在离散程度,且各类配置下的排名相关性均较弱。但失败模式具有结构性而非随机。相比边列表,邻接表编码始终降低误差并提高序数一致性;多分支推理在所有配置中均带来可观的综合增益。结果表明,在未进行任务特定微调或架构适配的情况下,预训练小模型的图属性推断本质上不可靠,但表示组织与推理设计仍能产生一致差异。研究揭示了结构化推理退化的条件,并识别出在模型容量受限下仍能提升表现的设计选择。

原文摘要 · Abstract (English)

Recent progress in language modeling has expanded the range of tasks that can be approached through natural language interfaces, including problems that require structured reasoning. However, it remains unclear how effectively limited-capacity language models can infer formal properties of relational structures when those structures are presented in textual form. We conduct a systematic study of graph-theoretic property inference in small instruction-tuned language models, isolating the roles of input representation and reasoning strategy. Across a diverse set of local and global graph metrics evaluated on three models, we find that small language models fail to achieve reliable graph property estimation: normalized errors consistently exceed the intrinsic dispersion of target properties, and rank correlations remain weak across all configurations. However, the failure is structured rather than uniform. Adjacency-list encodings consistently reduce error and improve ordinal consistency relative to edge-lists, and multi-branch reasoning yields measurable aggregate gains across configurations. These results show that without task-specific fine-tuning or architectural adaptation, graph property inference in pretrained small language models remains fundamentally unreliable, but that representational organization and inference design produce consistent differences. The findings characterize the conditions under which structured inference degrades and identify which design choices yield improvements even under constrained model capacity.

图神经网络小模型结构推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。