用自适应去噪提升图到文本生成的准确性和编辑响应能力
Factual and Edit-Sensitive Graph-to-Sequence Generation via Graph-Aware Adaptive Noising

- 基于图感知的自适应去噪机制,动态调节实体与关系的噪声水平
- 在三个数据集上超越大模型基线,编辑敏感度提升23.6%
- 适用于文本图和分子结构生成,通用性强
针对图到文本生成中事实准确性差、对图修改不敏感的问题,提出非自回归扩散框架DLM4G,通过迭代精炼生成文本。该方法将图中实体/关系与序列词元对齐,并设计逐词去噪误差驱动的自适应去噪策略,动态调整实体与关系词元的噪声强度,增强图结构保留能力并支持局部更新。在三个数据集上的实验表明,DLM4G显著优于对比的扩散基线,在表面形式与嵌入评估指标上均表现更优;相比最大12倍大的T5-Large等微调自回归模型,性能提升达12倍;在零样本大模型迁移下,可媲美127倍大的模型。相较于最强微调预训练模型,其事实准确性([email protected])提升+5.16%,编辑敏感性(ESR)提升+7.9%;相较最佳扩散基线,分别提升+3.75%与+23.6%。此外,在分子图像描述任务中也展现良好泛化能力,验证了其在科学领域图到文本生成中的通用性。
原文摘要 · Abstract (English)
Fine-tuned autoregressive models for graph-to-sequence generation (G2S) often struggle with factual grounding and edit sensitivity. To tackle these issues, we propose a non-autoregressive diffusion framework that generates text by iterative refinement conditioned on an input graph, named as Diffusion Language Model for Graphs (DLM4G). By aligning graph components (entities/relations) with their corresponding sequence tokens, DLM4G employs an adaptive noising strategy. The proposed strategy uses per-token denoising error as a signal to adaptively modulate noise on entity and relation tokens, improving preservation of graph structure and enabling localized updates under graph edits. Evaluated on three datasets, DLM4G consistently outperforms competitive G2S diffusion baselines trained on identical splits across both surface-form and embedding-based metrics. DLM4G further exceeds fine-tuned autoregressive baselines up to 12x larger (e.g., T5-Large) and is competitive with zero-shot LLM transfer baselines up to 127x larger. Relative to the strongest fine-tuned PLM baseline, DLM4G improves factual grounding ([email protected]) by +5.16% and edit sensitivity (ESR) by +7.9%; compared to the best diffusion baseline, it yields gains of +3.75% in [email protected] and +23.6% in ESR. We additionally demonstrate applicability beyond textual graphs through experiments on molecule captioning, indicating the method's generality for scientific G2S generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。