用社交图结构识别虚假投票,准确率超90%。
Leveraging the Power of AI and Social Interactions to Restore Trust in Public Polls
- 通过分析社交网络中的互动结构,不依赖内容判断参与真实性。
- 在真实数据集上对多种作弊行为检测,部分配置准确率达90%以上。
- 适合关注在线调查可信度、反作弊机制的研究者与应用开发者。
众包数据的兴起深刻改变了社会科学,使大规模探索人类集体行为、观点与社会动态成为可能。然而,确保参与的安全性、公平性与可靠性仍是长期挑战。传统问卷调查近年来参与度显著下降,引发数据可信度担忧。与此同时,社交与点对点网络日益普及,但平台数据常因虚假或不合格参与而存在可信度问题。本文探讨如何利用社交互动恢复众包数据的可信度。我们通过基于AI的社交互动图结构分析,实证研究了在包含诚实与不诚实参与者混合的投票任务中识别不合格参与的方法。该方法仅依赖社交互动图结构,不涉及信息内容。我们模拟了不同水平与类型的不诚实行为,即参与者试图在社交网络中传播任务。在真实社交网络数据集上进行实验,采用多种合格标准并建模多样参与模式。尽管社交互动图的结构差异带来一定性能波动,研究仍展现出优异的不合格参与检测效果,在部分配置下准确率超过90%。
原文摘要 · Abstract (English)
The emergence of crowdsourced data has significantly reshaped social science, enabling extensive exploration of collective human actions, viewpoints, and societal dynamics. However, ensuring safe, fair, and reliable participation remains a persistent challenge. Traditional polling methods have seen a notable decline in engagement over recent decades, raising concerns about the credibility of collected data. Meanwhile, social and peer-to-peer networks have become increasingly widespread, but data from these platforms can suffer from credibility issues due to fraudulent or ineligible participation. In this paper, we explore how social interactions can help restore credibility in crowdsourced data collected over social networks. We present an empirical study to detect ineligible participation in a polling task through AI-based graph analysis of social interactions among imperfect participants composed of honest and dishonest actors. Our approach focuses solely on the structure of social interaction graphs, without relying on the content being shared. We simulate different levels and types of dishonest behavior among participants who attempt to propagate the task within their social networks. We conduct experiments on real-world social network datasets, using different eligibility criteria and modeling diverse participation patterns. Although structural differences in social interaction graphs introduce some performance variability, our study achieves promising results in detecting ineligibility across diverse social and behavioral profiles, with accuracy exceeding 90% in some configurations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。