arXiv:2607.16660cs.SEcs.AI2026-07

开发者选AI模型只看性能成本,安全被忽视,易埋漏洞隐患。

From Adoption to Deployment: A Qualitative Study on AI Integration in Software Development Practice

  • 22名开发者访谈发现选型以功能为主,安全几乎不考虑。
  • 多数团队忽略软件供应链教训,重用轻安全,风险累积。
  • 建议从选型到部署全程引入安全评估,防患未然。

大型语言模型(LLMs)作为现代软件系统中的AI组件,正引入新的供应链安全风险。尽管传统软件依赖有成熟安全机制,但近期对AI组件和平台的快速采用却忽视了这些经验教训。缺乏明确指导选择和集成AI模型,可能导致应用面临恶意组件、数据泄露和意外行为等威胁。本研究通过半结构化访谈,调查22位来自不同组织的开发者、架构师和AI从业者在软件中集成AI组件的决策过程与安全考量。分析发现,实践者主要依据性能、准确率、成本及特定功能(如工具调用或多模态支持)选择模型,而安全极少作为评估标准。整个集成过程中普遍存在安全意识缺失,已有的软件供应链经验被忽视或忽略。行业正在重蹈早期依赖管理的历史性错误,过度追求快速复用与可用性,牺牲安全性与可溯源性。研究据此提出面向采纳者、模型提供方和研究者的可操作建议,倡导将安全评估融入组件选型,并贯穿软件开发生命周期,推行主动的安全设计。

原文摘要 · Abstract (English)

The increasing adoption of Large Language Models (LLMs) as AI components in modern software systems introduces distinct security risks to the software supply chain. While many considerations and safety mechanisms are in place for components of the traditional software supply chain, the recent rapid adoption of AI components and platforms has overlooked these hard learned lessons. Selecting and integrating AI models without clear guidance on how these choices affect system security may leave applications vulnerable to threats, such as malicious components, data leakage, and unintended behavior. The goal of this study is to understand practitioners' decision making process and security considerations in selecting and integrating AI components through an exploratory semi-structured interview study. Toward this goal, we conducted semistructured interviews with 22 software developers, architects, and AI practitioners across diverse organizations about how they integrate AI components into their software. Our analysis finds that practitioners' model selection is predominantly driven by functional criteria, including performance, accuracy, cost, and specific features, e.g., tool calling or multimodal support, while security is rarely considered as an evaluation criterion. We observe a consistent lack of security concern throughout the AI component integration process, with established software supply chain lessons overlooked or ignored. The industry is repeating the historically costly mistakes of early software dependency management, prioritizing rapid reuse and availability over security and provenance. We distill our findings into actionable recommendations for AI adopters, model providers, and researchers, advocating for a proactive, security-by-design approach that integrates security evaluation into component selection and sustains it throughout the software development lifecycle.

AI安全软件开发模型选型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。