arXiv:2510.17241cs.CYcs.AI2025-10被引 2

提出算法可见性系统框架,帮助理解信息推荐的运作与影响

Visibility Allocation Systems: How Algorithmic Design Shapes Online Visibility and Societal Outcomes

  • 将可见性分配系统分解为可分析的流程,用数据流图展示
  • 通过学校选择推荐案例验证框架有效性,支持系统评估
  • 适合研究者和立法者用于识别风险、制定合规策略

在各类应用场景中,我们广泛依赖算法系统处理不断增长的信息数据。尽管这些系统带来便利,但其结构复杂(包含大量工具如内容审核、推荐系统、预测模型)、文档缺失且后果难以预测,常引发严重下游影响(如系统性错误累积和反馈循环)。因此,对系统整体的理解与评估仍具挑战。本文提出一种形式化框架,用于分析可见性分配系统(VAS),即决定向用户呈现哪些处理后数据的(半)自动化系统。我们梳理了典型构成工具及其解决的计算问题,使系统可被拆解为子过程,并通过数据流图可视化。同时,我们综述了全链条评估指标,助力系统诊断。以学校选择中的基于预测的推荐为例,展示了该框架如何支持系统评估。此外,框架还可助力人工智能立法工作,协助界定责任、量化系统性风险并实现动态合规。

原文摘要 · Abstract (English)

Throughout application domains, we now rely extensively on algorithmic systems to engage with ever-expanding datasets of information. Despite their benefits, these systems are often complex (comprising of many intricate tools, e.g., moderation, recommender systems, prediction models), of unknown structure (due to the lack of accompanying documentation), and having hard-to-predict yet potentially severe downstream consequences (due to the extensive use, systematic enactment of existing errors, and many comprising feedback loops). As such, understanding and evaluating these systems as a whole remains a challenge for both researchers and legislators. To aid ongoing efforts, we introduce a formal framework for such visibility allocation systems (VASs) which we define as (semi-)automated systems deciding which (processed) data to present a human user with. We review typical tools comprising VASs and define the associated computational problems they solve. By doing so, VASs can be decomposed into sub-processes and illustrated via data flow diagrams. Moreover, we survey metrics for evaluating VASs throughout the pipeline, thus aiding system diagnostics. Using forecasting-based recommendations in school choice as a case study, we demonstrate how our framework can support VAS evaluation. We also discuss how our framework can support ongoing AI-legislative efforts to locate obligations, quantify systemic risks, and enable adaptive compliance.

算法治理可见性分配系统评估AI立法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。