改进检索模型对立场的判断能力,避免只看关键词或话题重叠。
Embedding Models for Stance-Aware Argument Retrieval

- 用诊断性词消融指标量化模型对立场关键词的过度依赖。
- 通过平衡数据集和大模型生成反向立场论点,提升模型深层逻辑理解。
- 适合需要精准立场识别的问答与论证系统开发者使用。
在计算论证任务中,获取明确支持或反驳特定主张的论据是下游推理的关键前提。使用语义搜索方法检索这些论据时,需同时评估其与目标主张的主题相关性及立场正确性(正向或负向)。本文探讨了现代检索管道中的密集嵌入模型(models)如何作为融合双重评估的语义搜索基础。实验表明,现有模型存在不对称推理缺陷,严重偏向主题重合而忽略立场判断。通过对比学习修正该偏差后,模型又出现新问题:过度关注极性关键词(如"支持"或"反驳"),忽视语义主题。为此,我们提出诊断性词消融指标来量化此现象,并提出数据驱动解决方案。通过实施平衡论证课程,结合大语言模型生成的立场反转论据,迫使嵌入模型学习更深层的方向性逻辑,而非依赖表面词汇捷径。评估显示,对于足够强大的模型,该方法可缓解过纠正问题,进一步提升立场感知论据检索性能。
原文摘要 · Abstract (English)
In computational argumentation, obtaining arguments that explicitly support or attack given claims is a critical precursor to downstream reasoning tasks. When these supporting and attacking arguments are to be retrieved using semantic search methods, they need to be assessed for topic-relevance to the claims of interest as well as for correctness of their (positive or negative) stance towards the claims. In this paper we explore how dense embedding models (hereafter, models), powering modern retrieval pipelines, can serve as the basis of semantic search incorporating this dual assessment. We show experimentally that existing models struggle with asymmetric reasoning, exhibiting a strong bias toward topical overlap while ignoring instructional stance. We also show that correcting this bias via contrastive training triggers a new failure mode where models over-correct, over-fixating on polarity keywords (e.g., "supports" or "refutes") at the expense of the semantic topic. We thus introduce diagnostic word-ablation metrics to quantify this phenomenon and propose a data-centric solution. By implementing a balanced argument curriculum alongside LLM-augmented, stance-inverted arguments, we force the (embedding) models to learn deeper directional logic rather than exploiting superficial lexical shortcuts. Our evaluation demonstrates that, for sufficiently powerful models, this approach can alleviate the observed overcorrection, achieving further improvements in stance-aware argument retrieval.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。