自动对齐游戏界面与交互设计,提升开发效率三倍。
AutoGameUI: Constructing High-Fidelity GameUI via Multimodal Correspondence Matching
- 分两阶段学习界面与交互的多模态特征,匹配最优对应关系。
- 在真实游戏数据上实现界面一致性,效率提升3倍。
- 适合游戏开发团队快速构建高保真界面,支持人机协同。
游戏用户界面(GameUI)开发对游戏产业至关重要。传统流程需大量手动工作将界面设计与交互设计整合,导致美学与功能不一致,造成匹配错误与效率低下。为此,我们提出AutoGameUI系统,通过双阶段多模态学习管道,实现界面与交互设计的最优匹配。第一阶段从多模态角度学习界面与交互的全面表征;第二阶段采用分组交叉注意力与约束整数规划,进行自顶向下的层次化匹配,获得最优对应关系,实现自动化的GameUI构建。我们构建了GAMEUI数据集,包含真实游戏的成对界面与交互设计,用于训练与验证。同时开发交互式Web工具,确保高保真效果并支持人机协同。在GAMEUI和RICO数据集上的实验表明,本系统能有效保持构建界面与原始设计的一致性。在多个移动端游戏中部署后,时间效率提升3×,具有显著实际价值。
原文摘要 · Abstract (English)
Game UI development is essential to the game industry. However, the traditional workflow requires substantial manual effort to integrate pairwise UI and UX designs into a cohesive game user interface (GameUI). The inconsistency between the aesthetic UI design and the functional UX design typically results in mismatches and inefficiencies. To address the issue, we present an automatic system, AutoGameUI, for efficiently and accurately constructing GameUI. The system centers on a two-stage multimodal learning pipeline to obtain the optimal correspondences between UI and UX designs. The first stage learns the comprehensive representations of UI and UX designs from multimodal perspectives. The second stage incorporates grouped cross-attention modules with constrained integer programming to estimate the optimal correspondences through top-down hierarchical matching. The optimal correspondences enable the automatic GameUI construction. We create the GAMEUI dataset, comprising pairwise UI and UX designs from real-world games, to train and validate the proposed method. Besides, an interactive web tool is implemented to ensure high-fidelity effects and facilitate human-in-the-loop construction. Extensive experiments on the GAMEUI and RICO datasets demonstrate the effectiveness of our system in maintaining consistency between the constructed GameUI and the original designs. When deployed in the workflow of several mobile games, AutoGameUI achieves a 3$\times$ improvement in time efficiency, conveying significant practical value for game UI development.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。