arXiv:2511.00020cs.AIcs.CL2025-11被引 19

融合文本与图像的假评论检测模型,准确率达93.4%。

Multimodal Detection of Fake Reviews using BERT and ResNet-50

  • 用BERT提取文本特征,ResNet-50提取图像特征,双模态融合判断真伪。
  • 在21,142张真实用户上传图片上测试,F1得分达0.934。
  • 擅长发现文字夸赞与图片不符等隐蔽造假行为,适合平台内容审核。

在当前数字商业环境中,用户生成的评论对消费者行为、产品声誉和平台信誉至关重要。然而,由机器人、付费人员或AI生成的虚假评论泛滥,严重威胁评论生态的信任与透明度。现有检测模型多依赖单一文本信息,难以捕捉跨模态语义不一致。为此,本文提出一种融合文本与图像的多模态假评论检测框架:使用BERT编码文本特征,通过ResNet-50提取图像特征,并以分类头联合预测评论真实性。研究基于包含21,142张用户上传图片的数据集(覆盖外卖、酒店及电商领域),实验表明该模型优于单模态基线,在测试集上达到0.934的F1分数。混淆矩阵与定性分析显示,模型能有效识别文字过度赞美但配图无关或质量低劣等典型欺骗模式。本研究证明多模态学习在维护数字信任中的关键作用,并为多种在线平台的内容审核提供可扩展解决方案。

原文摘要 · Abstract (English)

In the current digital commerce landscape, user-generated reviews play a critical role in shaping consumer behavior, product reputation, and platform credibility. However, the proliferation of fake or misleading reviews often generated by bots, paid agents, or AI models poses a significant threat to trust and transparency within review ecosystems. Existing detection models primarily rely on unimodal, typically textual, data and therefore fail to capture semantic inconsistencies across different modalities. To address this gap, a robust multimodal fake review detection framework is proposed, integrating textual features encoded with BERT and visual features extracted using ResNet-50. These representations are fused through a classification head to jointly predict review authenticity. To support this approach, a curated dataset comprising 21,142 user-uploaded images across food delivery, hospitality, and e-commerce domains was utilized. Experimental results indicate that the multimodal model outperforms unimodal baselines, achieving an F1-score of 0.934 on the test set. Additionally, the confusion matrix and qualitative analysis highlight the model's ability to detect subtle inconsistencies, such as exaggerated textual praise paired with unrelated or low-quality images, commonly found in deceptive content. This study demonstrates the critical role of multimodal learning in safeguarding digital trust and offers a scalable solution for content moderation across various online platforms.

假评论检测多模态学习BERTResNet-50

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。