用逆向设计生成带精准因果图标注的自然文本。
iTAG: Inverse Design for Natural Text Generation with Accurate Causal Graph Annotations
- 将因果图转为文本前,通过思维链迭代优化概念选择。
- 生成文本的因果标注准确率高,且语言自然流畅。
- 适合用于大规模因果发现算法的基准测试。
文本中因果关系发现的一大障碍是缺乏可作为真实标签的因果标注文本数据,因标注成本过高。这推动了生成带有因果图标注文本的重要任务。早期基于模板的方法牺牲了文本自然性以换取高标注准确率;近期依赖大模型的方法虽能生成自然文本,但无法保证因果图标注的准确性。为此,我们提出 iTAG,它在现有依赖大模型的方法中,先对节点进行真实世界概念赋值,再将因果图转为文本。iTAG 将此过程建模为逆问题,以因果图为目标,通过思维链(CoT)推理迭代检验并优化概念选择,使概念间推导出的关系尽可能与目标因果关系一致。iTAG 在多项测试中展现出极高的标注准确率和文本自然度,使用生成数据测试的因果发现算法结果与真实数据具有高度统计相关性。这表明 iTAG 生成的数据可作为文本因果发现算法可扩展基准测试的实际替代品。
原文摘要 · Abstract (English)
A fundamental obstacle to causal discovery from text is the lack of causally annotated text data for use as ground truth, due to high annotation costs. This motivates an important task of generating text with causal graph annotations. Early template-based generation methods sacrifice text naturalness in exchange for high causal graph annotation accuracy. Recent Large Language Model (LLM)-dependent methods directly generate natural text from target graphs through LLMs, but do not guarantee causal graph annotation accuracy. Therefore, we propose iTAG, which performs real-world concept assignment to nodes before converting causal graphs into text in existing LLM-dependent methods. iTAG frames this process as an inverse problem with the causal graph as the target, iteratively examining and refining concept selection through Chain-of-Thought (CoT) reasoning so that the induced relations between concepts are as consistent as possible with the target causal relationships described by the causal graph. iTAG demonstrates both extremely high annotation accuracy and naturalness across extensive tests, and the results of testing text-based causal discovery algorithms with the generated data show high statistical correlation with real-world data. This suggests that iTAG-generated data can serve as a practical surrogate for scalable benchmarking of text-based causal discovery algorithms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。