PASTA可快速评估多个AI政策合规性，省时省力。
PASTA: A Scalable Framework for Multi-Policy AI Compliance Evaluation
- 用统一格式和标准化流程整合多政策评估
- 5大政策评估<2分钟，成本约3美元
- 生成可读性强的合规热图与改进建议
随着AI系统日益强大和普及，AI合规性愈发重要。然而，政策快速扩展给资源有限且缺乏专业知识的实践者带来巨大负担。现有方法通常逐项处理单一政策，导致多政策评估成本高昂。我们提出PASTA，一种可扩展的合规评估框架，包含四项创新：(1) 支持全开发阶段描述性输入的通用模型卡片格式；(2) 政策标准化方案；(3) 基于高效LLM的成对评估引擎，配合降本策略；(4) 通过合规热图和可操作建议提供可解释评估结果。专家评估显示，PASTA判断与人类专家高度一致（ρ ≥ .626）。系统可在不到两分钟内完成五大主要政策评估，成本约3美元。用户研究（N = 12）证实，实践者认为输出易于理解且具可操作性，为可扩展的自动化AI治理提供了新范式。
原文摘要 · Abstract (English)
AI compliance is becoming increasingly critical as AI systems grow more powerful and pervasive. Yet the rapid expansion of AI policies creates substantial burdens for resource-constrained practitioners lacking policy expertise. Existing approaches typically address one policy at a time, making multi-policy compliance costly. We present PASTA, a scalable compliance tool integrating four innovations: (1) a comprehensive model-card format supporting descriptive inputs across development stages; (2) a policy normalization scheme; (3) an efficient LLM-powered pairwise evaluation engine with cost-saving strategies; and (4) an interface delivering interpretable evaluations via compliance heatmaps and actionable recommendations. Expert evaluation shows PASTA's judgments closely align with human experts ($ρ\geq .626$). The system evaluates five major policies in under two minutes at approximately \$3. A user study (N = 12) confirms practitioners found outputs easy-to-understand and actionable, introducing a novel framework for scalable automated AI governance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。