arXiv:2510.08111cs.CLcs.CY2025-10中稿 · publication at the…被引 4

用法律视角评估大模型对网红营销合规性的解释能力

Evaluating LLM-Generated Legal Explanations for Regulatory Compliance in Social Media Influencer Marketing

  • 对比两种模型在不同法律提示下的内容分类与解释表现
  • 发现模糊案例准确率下降超10%,隐藏广告错误率最高达28.57%
  • 构建法律推理错误分类体系,助力监管机构透明化审核

网红营销模糊了真实内容与广告之间的界限,使透明性法规执行变得困难。当前的未披露广告检测方法普遍缺乏法律依据或为不可解释的“黑箱”。基于1,143条Instagram帖子,我们比较了gpt-5-nano和gemini-2.5-flash-lite在三种提示策略下的表现,其中法律知识控制程度不同。两个模型在区分赞助内容方面表现良好(F1最高达0.93),但在模糊案例中性能下降超过10分。我们构建了推理错误分类体系,发现常见问题包括引用缺失(28.57%)、引用不清(20.71%),而隐藏广告的误判率最高达28.57%。尽管在提示中加入监管文本可提升解释质量,但未显著提高检测准确率。本研究贡献有三:一是提出评估大模型法律推理可靠性的错误分类体系,推动合规检测的法律可解释性;二是构建首个由受训学生标注的网红营销法律解释数据集;三是结合定量与定性评估,为广告监管机构提供自动化审核的法律基础支持。

原文摘要 · Abstract (English)

The rise of influencer marketing has blurred boundaries between organic content and sponsored content, making the enforcement of legal rules relating to transparency challenging. Effective regulation requires applying legal knowledge with a clear purpose and reason, yet current detection methods of undisclosed sponsored content generally lack legal grounding or operate as opaque "black boxes". Using 1,143 Instagram posts, we compare gpt-5-nano and gemini-2.5-flash-lite under three prompting strategies with controlled levels of legal knowledge provided. Both models perform strongly in classifying content as sponsored or not (F1 up to 0.93), though performance drops by over 10 points on ambiguous cases. We further develop a taxonomy of reasoning errors, showing frequent citation omissions (28.57%), unclear references (20.71%), and hidden ads exhibiting the highest miscue rate (28.57%). While adding regulatory text to the prompt improves explanation quality, it does not consistently improve detection accuracy. The contribution of this paper is threefold. First, it makes a novel addition to regulatory compliance technology by providing a taxonomy of common errors in LLM-generated legal reasoning to evaluate whether automated moderation is not only accurate but also legally robust, thereby advancing the transparent detection of influencer marketing content. Second, it features an original dataset of LLM explanations annotated by two students who were trained in influencer marketing law. Third, it combines quantitative and qualitative evaluation strategies for LLM explanations and critically reflects on how these findings can support advertising regulatory bodies in automating moderation processes on a solid legal foundation.

大模型评估法律合规网红营销解释生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。