arXiv:2503.09626cs.SIcs.AI2025-03被引 2

通过多模态不确定性建模,提升社交机器人检测的鲁棒性与可信度。

Certainly Bot Or Not? Trustworthy Social Bot Detection via Robust Multi-Modal Neural Processes

  • 引入证据门控网络,动态评估各模态可靠性,防止机器人伪装
  • 在三个真实数据集上实现高精度分类与可靠不确定性估计
  • 适合关注可信AI、反虚假信息系统的研究人员和工程师

社交机器人检测对缓解虚假信息、网络操控和协同不真实行为至关重要。现有基于神经网络的检测器在基准测试中表现良好,但在跨数据集分布偏移下泛化能力差,且对训练数据外账户预测过于自信。为此,本文提出不确定性估计框架UESBD,量化检测器的预测不确定性。核心方法为鲁棒多模态神经过程RMNP,通过模态特定编码器学习单模态表示,再用注意力神经过程建模各模态潜在变量的高斯分布。为防止机器人窃取人类特征进行伪装导致模态冲突,引入证据门控网络显式建模模态可靠性。联合潜变量分布通过广义专家乘积融合,综合考虑各模态可靠性。最终通过蒙特卡洛采样联合潜变量并经解码器输出预测。三个真实世界基准实验表明,RMNP在分类与不确定性估计方面均有效,且对模态冲突具有强鲁棒性。

原文摘要 · Abstract (English)

Social bot detection is crucial for mitigating misinformation, online manipulation, and coordinated inauthentic behavior. While existing neural network-based detectors perform well on benchmarks, they struggle with generalization due to distribution shifts across datasets and frequently produce overconfident predictions for out-of-distribution accounts beyond the training data. To address this, we introduce a novel Uncertainty Estimation for Social Bot Detection (UESBD) framework, which quantifies the predictive uncertainty of detectors beyond mere classification. For this task, we propose Robust Multi-modal Neural Processes (RMNP), which aims to enhance the robustness of multi-modal neural processes to modality inconsistencies caused by social bot camouflage. RMNP first learns unimodal representations through modality-specific encoders. Then, unimodal attentive neural processes are employed to encode the Gaussian distribution of unimodal latent variables. Furthermore, to avoid social bots stealing human features to camouflage themselves thus causing certain modalities to provide conflictive information, we introduce an evidential gating network to explicitly model the reliability of modalities. The joint latent distribution is learned through the generalized product of experts, which takes the reliability of each modality into consideration during fusion. The final prediction is obtained through Monte Carlo sampling of the joint latent distribution followed by a decoder. Experiments on three real-world benchmarks show the effectiveness of RMNP in classification and uncertainty estimation, as well as its robustness to modality conflicts.

社交机器人不确定性估计多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。