arXiv:2509.00740cs.AIcs.LG2025-09被引 1

不微调大模型,用结构化信息注入提升图任务理解能力

Efficient Graph Understanding with LLMs via Structured Context Injection

  • 将任务特定信息以结构化方式直接注入输入,引导大模型推理
  • 在多个图任务上实现性能提升,效果媲美复杂方法
  • 无需微调,适合快速部署于轻量或大型语言模型

大型语言模型(LLMs)在跨领域问题求解中展现出强大能力,包括传统上由符号或算法方法处理的图相关任务。本文提出一种结构化上下文注入框架,将任务特定信息系统性地嵌入输入,以指导LLMs解决多种图问题。该方法无需微调模型,具有成本低、轻量高效的优势。我们发现,某些图推理任务对LLMs仍具挑战性,除非将其映射到概念上可解释的表示空间。而通过微调或重复多步查询实现此类映射往往代价高昂且效率低下。我们的方法通过直接在输入中注入结构化上下文,使模型隐式对齐至具象化的概念空间。我们在轻量与大型模型上评估了多种图任务,揭示了准确率与计算成本之间的权衡。结果表明,结构化输入上下文能持续提升性能,其表现可媲美甚至超越更复杂的方案。研究证实,结构化上下文注入是实现高效、可扩展图理解的有效策略。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have shown strong capabilities in solving problems across domains, including graph-related tasks traditionally addressed by symbolic or algorithmic methods. In this work, we present a framework for structured context injection, where task-specific information is systematically embedded in the input to guide LLMs in solving a wide range of graph problems. Our method does not require fine-tuning of LLMs, making it cost-efficient and lightweight. We observe that certain graph reasoning tasks remain challenging for LLMs unless they are mapped to conceptually grounded representations. However, achieving such mappings through fine-tuning or repeated multi-step querying can be expensive and inefficient. Our approach offers a practical alternative by injecting structured context directly into the input, enabling the LLM to implicitly align the task with grounded conceptual spaces. We evaluate the approach on multiple graph tasks using both lightweight and large models, highlighting the trade-offs between accuracy and computational cost. The results demonstrate consistent performance improvements, showing that structured input context can rival or surpass more complex approaches. Our findings underscore the value of structured context injection as an effective and scalable strategy for graph understanding with LLMs.

图神经网络大模型应用提示工程上下文注入

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。