arXiv:2601.16519cs.LG2026-01

DANCE提升联邦文本图学习效率与可解释性

DANCE: Dynamic, Available, Neighbor-gated Condensation for Federated Text-Attributed Graphs

  • 动态迭代式图压缩,结合全局模型实时优化
  • 8%压缩率下准确率提升2.33%,用词量减少33.42%
  • 保留原始文本溯源信息,支持本地可审计

联邦图学习(FGL)使多方能在分布式图数据上协同训练。随着大语言模型(LLMs)兴起,文本属性在FGL中日益重要。文本属性联邦学习(TAG-FGL)通过显式利用LLMs处理和融合文本特征,提升了传统FGL。然而现有方法面临三大挑战:(1) 开销大——长文本处理导致高令牌数与计算成本;(2) 性能差——现有图压缩(GC)采用一次性静态压缩,不适应客户端差异,影响效果;(3) 不可解释——基于LLM的压缩引入黑箱瓶颈,摘要缺乏对原始文本片段的精准溯源,难以本地审查。为此,本文提出新范式DANCE,通过轮次式、模型驱动的动态图压缩刷新机制,提升性能;同时保留证据包,追踪预测来源至具体邻居节点和原文段落,增强可解释性。在8个TAG数据集上,DANCE以8%压缩比实现2.33%准确率提升,相比基线节省33.42%令牌消耗。

原文摘要 · Abstract (English)

Federated graph learning (FGL) enables collaborative training on graph data across multiple clients. With the rise of large language models (LLMs), textual attributes in FGL graphs are gaining attention. Text-attributed graph federated learning (TAG-FGL) improves FGL by explicitly leveraging LLMs to process and integrate these textual features. However, current TAG-FGL methods face three main challenges: \textbf{(1) Overhead.} LLMs for processing long texts incur high token and computation costs. To make TAG-FGL practical, we introduce graph condensation (GC) to reduce computation load, but this choice also brings new issues. \textbf{(2) Suboptimal.} To reduce LLM overhead, we introduce GC into TAG-FGL by compressing multi-hop texts/neighborhoods into a condensed core with fixed LLM surrogates. However, this one-shot condensation is often not client-adaptive, leading to suboptimal performance. \textbf{(3) Interpretability.} LLM-based condensation further introduces a black-box bottleneck: summaries lack faithful attribution and clear grounding to specific source spans, making local inspection and auditing difficult. To address the above issues, we propose \textbf{DANCE}, a new TAG-FGL paradigm with GC. To improve \textbf{suboptimal} performance, DANCE performs round-wise, model-in-the-loop condensation refresh using the latest global model. To enhance \textbf{interpretability}, DANCE preserves provenance by storing locally inspectable evidence packs that trace predictions to selected neighbors and source text spans. Across 8 TAG datasets, DANCE improves accuracy by \textbf{2.33\%} at an \textbf{8\%} condensation ratio, with \textbf{33.42\%} fewer tokens than baselines.

联邦学习图神经网络文本生成可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。