分析十万用户评论发现,伦理设计显著提升满意度,尤其对普通用户更关键。
Do Ethical AI Principles Matter to Users? A Large-Scale Analysis of User Sentiment and Satisfaction
- 基于欧盟伦理准则,用大模型分析七维度伦理特征
- 所有伦理维度均正向影响满意度,非技术用户影响更强
- 开发平台用户关注系统透明性,终端用户重视人性关怀
随着AI系统深度嵌入组织流程与消费应用,公平、透明、稳健等伦理原则虽在政策与行业指南中广泛倡导,但缺乏来自用户视角的实证证据。本研究通过分析G2平台超过10万条AI产品用户评论,利用基于Transformer的语言模型,测量欧盟可信AI伦理指南定义的七个伦理维度的情感倾向。结果表明,所有七个维度均与用户满意度正相关,且这种关联随用户类型和产品类型系统性变化:技术用户及开发者平台评论更关注系统级议题(如透明性、数据治理),非技术用户及终端应用评论则强调以人为本维度(如人类自主性、社会福祉)。此外,在所有维度上,伦理设计对非技术用户及终端应用的满意度提升效应均显著更强。研究凸显了从用户视角出发设计伦理AI的重要性,并强调需考虑用户角色与产品类型的上下文差异。
原文摘要 · Abstract (English)
As AI systems become increasingly embedded in organizational workflows and consumer applications, ethical principles such as fairness, transparency, and robustness have been widely endorsed in policy and industry guidelines. However, there is still scarce empirical evidence on whether these principles are recognized, valued, or impactful from the perspective of users. This study investigates the link between ethical AI and user satisfaction by analyzing over 100,000 user reviews of AI products from G2. Using transformer-based language models, we measure sentiment across seven ethical dimensions defined by the EU Ethics Guidelines for Trustworthy AI. Our findings show that all seven dimensions are positively associated with user satisfaction. Yet, this relationship varies systematically across user and product types. Technical users and reviewers of AI development platforms more frequently discuss system-level concerns (e.g., transparency, data governance), while non-technical users and reviewers of end-user applications emphasize human-centric dimensions (e.g., human agency, societal well-being). Moreover, the association between ethical AI and user satisfaction is significantly stronger for non-technical users and end-user applications across all dimensions. Our results highlight the importance of ethical AI design from users' perspectives and underscore the need to account for contextual differences across user roles and product types.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。