用大模型重写对话输入,发现修复效果有限且易引入新错误。
Beyond Supervised Clarification: Input Rewriting with LLMs for Dialogue Discourse Parsing

- 让大模型自动重写对话片段以提升解析准确率
- 重写后约37%的错误被减少,但多数问题无法仅靠重写解决
- 需先判断能否修复,才能有效优化对话解析流程
在现代自然语言处理流水线中,通过重写输入来改善冻结下游模型的表现已成为常见策略。先前针对增量对话篇章解析(DDP)的研究表明,有监督的澄清模型能改写不完整或模糊的语句(如消解省略和指代),从而提升解析准确率。本文在无澄清标注的真实部署条件下重新审视这一思路,发现基于最后一句话的澄清远不如有监督设置下可靠。无需监督的重写常导致更多错误,因为修改虽可修复问题,却也破坏了解析器依赖的篇章线索。对最佳8种重写方案的分析显示,错误中有很大比例无法仅通过输入重写解决。使用GRPO训练的解析器感知澄清器可将回归减少高达37%,但仍无法生成始终提升解析效果的选择性澄清。这些发现将澄清重新定义为选择性干预问题,指出重写可行性预测——即在干预前判断语句是否可修复——是输入端优化冻结篇章解析器的关键缺失能力,也是改进智能体流水线的重要方向。
原文摘要 · Abstract (English)
Rewriting inputs to improve frozen downstream models has become a common strategy in modern NLP pipelines. Prior work on incremental dialogue discourse parsing (DDP) shows that supervised clarification models can rewrite fragmentary or underspecified utterances, such as resolving ellipsis or references, to improve parsing accuracy. In this work, we revisit this idea under realistic deployment conditions, where no clarification supervision is available and the clarifier must rely on zero-shot prompting or feedback from a frozen parser. Across three Segmented Discourse Representation Theory (SDRT) datasets and multiple parsers, we find that last-utterance clarification is far less reliable than suggested by supervised settings. Parser-agnostic rewriting often introduces more regressions than repairs, as edits that enable fixes also disrupt discourse cues relied upon by the parser. A best-of-8 rewriting analysis further reveals a practical ceiling: a large fraction of errors are not repairable through input rewriting alone. A parser-aware clarifier trained with GRPO reduces regressions by up to 37% by learning conservative abstention, yet still fails to produce selectivity-aware clarifications that consistently improve parsing. Together, these findings recast clarification as a selective intervention problem. We identify rewritability prediction, deciding whether an utterance is repairable before intervention, as the key missing capability for input-side optimization of frozen discourse parsers, and a critical direction for improving agentic pipelines more broadly.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。