AI推动产品开发需警惕风险，关键在人控与透明设计。
Risks of AI-driven product development and strategies for their mitigation
- 提出人机协同、可解释性等安全原则
- 涵盖技术缺陷与社会影响双重风险
- 适合政策制定者与研发团队参考
人类正迈向自动化产品开发，有望加速技术进步。但对非人类智能体的过度依赖带来多重风险。本文旨在探讨这些风险并提出缓解策略，提出一系列安全原则，强调人类监督、责任归属与可解释性设计。风险评估涵盖影响产品质量与安全的技术风险，以及影响社会的社技术风险。尽管该领域仍处于早期阶段，此讨论有助于在不延迟理解、规范与监管进程的前提下，平衡其机遇与风险。
原文摘要 · Abstract (English)
Humanity is progressing towards automated product development, a trend that promises faster creation of better products and thus the acceleration of technological progress. However, increasing reliance on non-human agents for this process introduces many risks. This perspective aims to initiate a discussion on these risks and appropriate mitigation strategies. To this end, we outline a set of principles for safer AI-driven product development which emphasize human oversight, accountability, and explainable design, among others. The risk assessment covers both technical risks which affect product quality and safety, and sociotechnical risks which affect society. While AI-driven product development is still in its early stages, this discussion will help balance its opportunities and risks without delaying essential progress in understanding, norm-setting, and regulation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。