arXiv:2607.28750cs.SEcs.AI2026-07

用大模型生成用户意图,自动测试移动应用关键流程,提升回归测试效率。

DragonCrawl: A Generative, Intent-Based Framework for Scalable Mobile End-to-End Testing

论文配图:DragonCrawl: A Generative, Intent-Based Framework for Scalable Mobile End-to-End Testing
图 1 · 摘自论文原文
  • 基于大模型生成用户操作意图,替代传统脆弱的UI匹配测试
  • 在CI/CD中运行1013次测试,安卓通过率92.2%,iOS通过率91.6%
  • 测试搭建时间从120小时缩短至4小时,节省27名开发者年维护工作量

随着移动应用复杂度提升,传统端到端(E2E)测试面临UI不稳定、维护成本高和跨平台扩展难的问题。本文提出DragonCrawl,一个基于大语言模型的AI驱动测试系统,支持持续回归测试。该系统从基于语义嵌入的匹配方法演进为生成式意图推理,不同于以往聚焦探索性测试和崩溃检测的研究,DragonCrawl在每次代码变更时验证特定用户流程,阻止破坏核心功能的提交。利用GPT-4o的多模态能力,系统在持续集成流水线中完成1,013次自动化测试,安卓通过率达92.2%,iOS通过率为91.6%。测试部署时间从96-120小时降至4小时以下,预计节省27名开发者年的工作量。系统通过多模态视觉识别最终状态并调用工具处理后端状态转移,实现从界面交互到系统状态的完整覆盖。实证表明,AI驱动的测试可在保持稳定性的同时消除传统自动化测试的脆弱性,支持大规模持续质量保障。

原文摘要 · Abstract (English)

As mobile applications grow in complexity, traditional End-to-End (E2E) testing frameworks struggle with UI volatility, maintenance overhead, and cross-platform scalability. This paper presents DragonCrawl, an AI-driven mobile testing system for continuous regression testing that has evolved from embedding-based similarity matching to generative intent-based reasoning using large language models. Unlike prior LLM-based testing research focused on exploratory testing and crash detection, DragonCrawl validates specific user flows on every code change, blocking commits that break critical functionality. By leveraging GPT-4o's multimodal capabilities, DragonCrawl achieves 91.6% pass rate on iOS and 92.2% on Android across 1,013 automated tests running continuously in CI/CD pipelines. The system reduces test onboarding time from 96-120 hours to under 4 hours and has saved an estimated 27 developer years in test maintenance effort. We present the architectural evolution from V1 (semantic embedding matching) to V2 (generative intent-based reasoning), discuss implementation challenges including token explosion and memory constraints, and report operational experience from production deployment. The integration of multimodal vision for end-state detection and tool calling for backend state transitions enables comprehensive regression testing that bridges UI interactions with system state. Our results demonstrate that AI-driven testing can maintain stability while eliminating the brittleness of traditional automated tests, enabling continuous quality assurance at scale.

移动端测试大模型应用持续集成生成式AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。