arXiv:2608.12269cs.CL2026-08

用轻量NLP pipeline从采购评论中自动识别举报性语言,提升政府资金监管透明度。

A Cascaded Unsupervised-Supervised NLP Pipeline for Detecting Accusatory Language in Public Procurement

论文配图:A Cascaded Unsupervised-Supervised NLP Pipeline for Detecting Accusatory Language in Public Procurement
图 1 · 摘自论文原文
  • 先无监督聚类后有监督分类,结合领域词向量与随机森林模型
  • 在严重不平衡数据下仍达高查准率和查全率,准确识别举报类评论
  • 适合关注公共治理、反腐败的政策研究者和审计人员使用

公共采购涉及大量财政资源分配,需通过审计与监控持续监督。然而,利益相关方评论及公开政府数据常被忽视,尽管其可能揭示程序异常。本文分析厄瓜多尔官方采购系统(SOCE)的元数据,重点关注合同前阶段参与者生成的评论。提出一种融合无监督聚类与有监督分类的混合自然语言处理框架,以发现潜在模式并检测可疑采购行为。采用Word2Vec、LLaMA和RoBERTa生成语义嵌入,经高斯混合模型(GMM)进行无监督聚类,再通过随机森林分类器识别指控或举报类评论。实验表明,在严重类别不平衡条件下,基于领域训练的Word2Vec嵌入、GMM聚类与随机森林组合仍能实现高精度与高召回率。结果证明,轻量级、领域适配的NLP架构可在无需大规模算力的情况下有效支持风险识别,提升公共采购系统的透明度。

原文摘要 · Abstract (English)

Public procurement involves the allocation of substantial financial resources; therefore, continuous oversight through audits, controls, and monitoring mechanisms is essential. However, stakeholder comments and publicly available government data are often underutilized, despite their potential to reveal procedural irregularities. To address this gap, this paper analyzes metadata from Ecuador's Sistema Oficial de Contratación Pública (SOCE, Official Public Procurement System), with particular emphasis on participant comments generated during the pre-contractual phase. We propose a hybrid modeling framework that integrates unsupervised clustering and supervised classification within a natural language processing (NLP) pipeline to uncover latent patterns and detect potentially irregular procurement processes. Semantic embeddings are generated using Word2Vec, LLaMA, and RoBERTa, followed by Gaussian Mixture Models (GMMs) for unsupervised clustering. A supervised classification stage is then applied to identify accusatory or whistleblowing-style comments. Experimental results show that the combination of domain-trained Word2Vec embeddings, GMM-based clustering, and a Random Forest classifier achieves high precision and recall, even under severe class imbalance. These findings demonstrate that lightweight, domain-adapted NLP architectures can effectively support risk identification and enhance transparency in public procurement systems without requiring large-scale computational infrastructure.

自然语言处理公共采购举报检测轻量模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。