arXiv:2603.04707cs.CLcs.AI2026-03中稿 · publication in the…

用大模型检测网络黑市内容,多类别识别效果远超传统方法。

Detection of Illicit Content on Online Marketplaces using Large Language Models

  • 用Llama 3.2和Gemma 3微调,结合参数高效训练与量化技术。
  • 40类非法内容分类任务中,大模型准确率显著高于BERT和传统算法。
  • 适合平台安全、执法机构及网络安全团队快速部署智能审核系统。

在线市场虽推动全球贸易发展,却也助长了毒品交易、假货销售和网络犯罪等非法活动。传统内容审核方式如人工审查和规则引擎存在可扩展性差、语言伪装应对弱及多语种处理难等问题。常规机器学习模型在面对非法交易沟通中的语义复杂性和语言细微差别时表现不佳。本研究评估了大型语言模型(LLMs),特别是Meta的Llama 3.2和Google的Gemma 3,在多语言DUTA10K数据集上检测与分类非法在线市场内容的有效性。通过参数高效微调(PEFT)和量化技术,将这些模型与基础Transformer模型(BERT)及传统机器学习基线(支持向量机、朴素贝叶斯)进行系统对比。实验结果显示:在二分类任务(非法 vs 非法)中,Llama 3.2表现接近传统方法;但在包含40个具体非法类别的复杂、不平衡多分类任务中,其性能显著优于所有基线模型。该研究为提升在线安全提供了切实可行方案,助力电商平台、执法部门和网络安全专家获得更高效、可扩展且自适应的非法内容检测工具。

原文摘要 · Abstract (English)

Online marketplaces, while revolutionizing global commerce, have inadvertently facilitated the proliferation of illicit activities, including drug trafficking, counterfeit sales, and cybercrimes. Traditional content moderation methods such as manual reviews and rule-based automated systems struggle with scalability, dynamic obfuscation techniques, and multilingual content. Conventional machine learning models, though effective in simpler contexts, often falter when confronting the semantic complexities and linguistic nuances characteristic of illicit marketplace communications. This research investigates the efficacy of Large Language Models (LLMs), specifically Meta's Llama 3.2 and Google's Gemma 3, in detecting and classifying illicit online marketplace content using the multilingual DUTA10K dataset. Employing fine-tuning techniques such as Parameter-Efficient Fine-Tuning (PEFT) and quantization, these models were systematically benchmarked against a foundational transformer-based model (BERT) and traditional machine learning baselines (Support Vector Machines and Naive Bayes). Experimental results reveal a task-dependent advantage for LLMs. In binary classification (illicit vs. non-illicit), Llama 3.2 demonstrated performance comparable to traditional methods. However, for complex, imbalanced multi-class classification involving 40 specific illicit categories, Llama 3.2 significantly surpassed all baseline models. These findings offer substantial practical implications for enhancing online safety, equipping law enforcement agencies, e-commerce platforms, and cybersecurity specialists with more effective, scalable, and adaptive tools for illicit content detection and moderation.

大模型内容检测非法内容多语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。