首个系统性研究安卓到鸿蒙的GUI测试迁移,发现现有方法效果差且提出改进方案。
An Empirical Study for Android-to-OpenHarmony GUI Test Migration

- 构建包含36款应用的ATH基准数据集,评估迁移效果
- 现有迁移方法在鸿蒙上成功率仅15%~26%,主要受系统特性制约
- 基于ITeM改进的ITeM-HM提升成功率至81%,适配鸿蒙生态
为降低从Android迁移至OpenHarmony应用时的测试工程成本,迁移现有GUI测试用例成为关键问题。然而,当前研究既缺乏针对OpenHarmony的定制解决方案,也未提供系统性评估,导致开发者实践缺乏实证指导。本文首次开展安卓到鸿蒙测试迁移的系统性实证研究。首先构建ATH基准数据集,包含36款商业应用(平均下载量超90亿)及108个手动设计的测试用例;其次选取两种先进测试迁移方法(ReSPlay和ITeM),并适配其在OpenHarmony上的运行;最后从测试性能、失败原因及鸿蒙特性影响三方面评估。结果表明,现有方法在安卓到鸿蒙场景中效果较差(ReSPlay成功率为15%,ITeM为26%)。深入分析显示,测试失败主要源于鸿蒙特有的技术架构差异与生态特征。基于此,提出改进方法ITeM-HM,融合鸿蒙系统特性。实验显示,ITeM-HM相较原版提升214%成功率(从26%增至81%)。
原文摘要 · Abstract (English)
To reduce the substantial engineering effort required to test the corresponding applications from Android to OpenHarmony, migrating existing GUI test cases has become a critical problem. However, current research neither proposes solutions tailored for OpenHarmony nor provides a systematic evaluation of migration approaches on this system, leaving developers with limited empirical guidance in practice. In this paper, we present the first systematic empirical study of test migration from Android to OpenHarmony. Specifically, we first construct a dataset referred to as the ATH Benchmark, comprising 36 commercial applications with an average of over 9 billion downloads, along with 108 manually designed test cases. Second, we select two state-of-the-art test migration approaches (i.e., ReSPlay and ITeM) and adapt these two approaches to enable their execution on OpenHarmony. Third, we use the preceding infrastructure to evaluate these two approaches from three perspectives, including testing performance, root causes of failures, and the impact of OpenHarmony characteristics. Our results reveal that existing test migration approaches are less effective (15% success-rate on ReSPlay and 26% success-rate on ITeM) in Android-to-OpenHarmony scenarios. Through an in-depth analysis of failed cases, we identify that test performance is primarily hindered by OpenHarmony-specific characteristics, including technical architecture differences and unique ecosystem traits. Utilizing these findings, we propose an enhanced approach based on ITeM, referred as ITeM-HM, which incorporates specific OpenHarmony system features. As a result, ITeM-HM successfully achieves a 214% success-rate relative improvement over the original ITeM (from 26% to 81%).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。