用大模型生成知识图谱,让普通用户也能轻松增强图数据。
Democratizing Large Language Model-Based Graph Data Augmentation via Latent Knowledge Graphs
- 通过文本提示引导大模型生成知识图谱,融合上下文信息。
- 在电子健康记录任务中提升预测性能,准确率显著优于基线方法。
- 黑箱设计兼容封闭模型,适合无权访问大模型的普通研究者使用。
图表示学习受限于图数据的稀缺性和噪声,数据增强至关重要。现有方法多仅依赖图结构,忽略数据集蕴含的上下文信息。尽管基于大语言模型(LLM)的方法表现优异,但多数为白盒,需访问模型权重或隐状态,难以普及。为此,我们提出黑箱式上下文驱动的图数据增强方法DemoGraph:利用文本提示作为上下文,指令大模型生成知识图谱(KG),捕获文本输出中的结构化交互;设计动态合并策略,在训练中随机融合生成的KG到原图;引入粒度感知提示策略与指令微调模块,按数据粒度自适应生成提示以控制增强后图的稀疏性。在多个图学习任务上的实验验证了方法的有效性,尤其在电子健康记录(EHR)场景中表现突出,充分挖掘上下文知识,显著提升预测性能与可解释性。
原文摘要 · Abstract (English)
Data augmentation is necessary for graph representation learning due to the scarcity and noise present in graph data. Most of the existing augmentation methods overlook the context information inherited from the dataset as they rely solely on the graph structure for augmentation. Despite the success of some large language model-based (LLM) graph learning methods, they are mostly white-box which require access to the weights or latent features from the open-access LLMs, making them difficult to be democratized for everyone as existing LLMs are mostly closed-source for commercial considerations. To overcome these limitations, we propose a black-box context-driven graph data augmentation approach, with the guidance of LLMs -- DemoGraph. Leveraging the text prompt as context-related information, we task the LLM with generating knowledge graphs (KGs), which allow us to capture the structural interactions from the text outputs. We then design a dynamic merging schema to stochastically integrate the LLM-generated KGs into the original graph during training. To control the sparsity of the augmented graph, we further devise a granularity-aware prompting strategy and an instruction fine-tuning module, which seamlessly generates text prompts according to different granularity levels of the dataset. Extensive experiments on various graph learning tasks validate the effectiveness of our method over existing graph data augmentation methods. Notably, our approach excels in scenarios involving electronic health records (EHRs), which validates its maximal utilization of contextual knowledge, leading to enhanced predictive performance and interpretability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。