arXiv:2506.21443cs.CLcs.AI2025-06被引 9

用领域知识增强大模型,精准识别动态对话中的欺诈与语义漂移。

Domain Knowledge-Enhanced LLMs for Fraud and Concept Drift Detection

  • 融合结构化领域知识与大模型,提升上下文理解能力。
  • 在真实对话数据集上实现98%的欺诈分类准确率。
  • 适合安全敏感场景下的风险对话检测系统开发。

动态平台上的欺骗性对话检测日益困难,源于语言模式的演化及语义或主题漂移(Concept Drift)——即交互内容或意图随时间变化,使恶意行为难以识别或伪装成正常对话。尽管大语言模型(LLMs)在自然语言任务中表现优异,但在高风险场景下仍面临上下文模糊和幻觉问题。为此,我们提出一种领域知识(DK)增强的LLM框架,将预训练模型与特定任务的结构化知识结合,用于欺诈与概念漂移检测。该框架包含三个组件:(1) DK-LLM模块识别虚假对话;(2) 漂移检测单元(OCDD)判断是否发生语义漂移;(3) 第二个DK-LLM模块将漂移分类为良性或欺诈。首先在虚假评论数据集上验证领域知识价值,再应用于包含多种欺诈与垃圾攻击的多轮对话数据集SEConvo。结果表明,系统能高效检测虚假对话并准确分类漂移类型。基于结构化提示的LLaMA实现达到98%分类准确率。与零样本基线对比显示,引入领域知识与漂移感知显著提升了性能、可解释性与鲁棒性,适用于高风险NLP应用。

原文摘要 · Abstract (English)

Detecting deceptive conversations on dynamic platforms is increasingly difficult due to evolving language patterns and Concept Drift (CD)-i.e., semantic or topical shifts that alter the context or intent of interactions over time. These shifts can obscure malicious intent or mimic normal dialogue, making accurate classification challenging. While Large Language Models (LLMs) show strong performance in natural language tasks, they often struggle with contextual ambiguity and hallucinations in risk-sensitive scenarios. To address these challenges, we present a Domain Knowledge (DK)-Enhanced LLM framework that integrates pretrained LLMs with structured, task-specific insights to perform fraud and concept drift detection. The proposed architecture consists of three main components: (1) a DK-LLM module to detect fake or deceptive conversations; (2) a drift detection unit (OCDD) to determine whether a semantic shift has occurred; and (3) a second DK-LLM module to classify the drift as either benign or fraudulent. We first validate the value of domain knowledge using a fake review dataset and then apply our full framework to SEConvo, a multiturn dialogue dataset that includes various types of fraud and spam attacks. Results show that our system detects fake conversations with high accuracy and effectively classifies the nature of drift. Guided by structured prompts, the LLaMA-based implementation achieves 98% classification accuracy. Comparative studies against zero-shot baselines demonstrate that incorporating domain knowledge and drift awareness significantly improves performance, interpretability, and robustness in high-stakes NLP applications.

欺诈检测语义漂移大模型增强对话安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。